00000001:02000400:1.0F:1788908961.638081:0:2958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788908973.116367:0:3160:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788908975.252710:0:3220:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 731 MB/s 00000001:01000000:2.0:1788908975.503411:0:3220:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 629 MB/s 00000001:01000000:1.0:1788908975.754219:0:3220:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4191 MB/s 00000020:02000000:1.0:1788908976.654262:0:3252:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_86_g8205644 00000400:02000000:0.0F:1788908977.721632:0:3267:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.154@tcp [8/256/0/180] 00008000:02000000:0.0:1788908981.686832:0:3416:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788909030.679627:0:5221:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788909040.226325:0:5803:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788909040.226334:0:5803:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788909040.226604:0:5803:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000054ee7130 00000080:02000400:0.0:1788909040.226616:0:5803:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788909040.233568:0:5803:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788909040.233590:0:5803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788909040.234903:0:5803:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000395d2ff8) 00000020:00000080:0.0:1788909040.235300:0:5803:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788909040.278771:0:5803:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788909040.279308:0:5803:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788909040.316638:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788909040.316697:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788909040.316723:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788909040.317068:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788909040.317097:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788909040.318449:0:5803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788909040.318459:0:5803:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788909040.318472:0:5803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d52b7 00000020:01000004:3.0:1788909040.318483:0:5803:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788909040.318488:0:5803:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788909040.318493:0:5803:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000054ee7130 from MGS 00000020:01000004:3.0:1788909040.318498:0:5803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788909040.318522:0:5803:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b73acc7b) 00000020:00000080:3.0:1788909040.318534:0:5803:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788909040.318613:0:5803:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000054ee7130 from MGS, refs=2 00080000:01000000:3.0:1788909040.318619:0:5803:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788909040.318624:0:5803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d52c5 00000100:00100000:3.0:1788909040.318745:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788909040.318879:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788909040.318886:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788909040.323301:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788909040.323319:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788909040.324412:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788909040.324826:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788909040.324840:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788909040.325699:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788909040.325709:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788909040.326139:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788909040.326146:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788909040.326877:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909040.326880:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909040.326882:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909040.327512:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909040.327515:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909040.327517:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909040.328568:0:5803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788909040.329173:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788909040.578284:0:5803:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3215 MB/s 00000001:01000000:3.0:1788909040.828410:0:5803:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2951 MB/s 00000001:01000000:3.0:1788909041.079307:0:5803:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 593 MB/s 00000001:01000000:1.0:1788909041.330557:0:5803:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 729 MB/s 00080000:10000000:1.0:1788909041.338861:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1788909041.352546:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788909041.361219:0:5803:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788909041.361238:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788909041.361241:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788909041.365235:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788909041.365385:0:5803:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788909041.365507:0:5803:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788909041.365923:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788909041.365953:0:5803:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788909041.366779:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788909041.368362:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788909041.368372:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788909041.370430:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788909041.370443:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788909041.370752:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788909041.370759:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788909041.371675:0:5803:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788909041.371697:0:5803:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:3.0:1788909041.371699:0:5803:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788909041.371749:0:5803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:3.0:1788909041.371761:0:5803:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (000000001925efbd) 00000020:00000080:3.0:1788909041.371777:0:5803:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788909041.371849:0:5803:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000a9fc563@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788909041.372610:0:5803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:3.0:1788909041.372620:0:5803:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788909041.373236:0:5818:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788909041.379165:0:5820:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788909041.379267:0:5803:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid de4f34ee-762f-480d-9428-329e99488659) 00000020:00000080:3.0:1788909041.379295:0:5803:0:(genops.c:1385:class_connect()) connect: client de4f34ee-762f-480d-9428-329e99488659, cookie 0x733cfdd8721d52d3 00000100:00080000:3.0:1788909041.379311:0:5803:0:(import.c:510:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788909041.379316:0:5803:0:(import.c:624:import_select_connection()) MGC192.168.204.154@tcp: import 000000000a9fc563 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788909041.379373:0:5803:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001ef36ce6 x1875807019466880/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788909041.379399:0:5803:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import de4f34ee-762f-480d-9428-329e99488659->MGS 00000020:01000004:3.0:1788909041.379429:0:5803:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788909041.379435:0:5803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788909041.379451:0:5803:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000056db2b05) 00000020:00000080:3.0:1788909041.379463:0:5803:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788909041.381322:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ef36ce6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de4f34ee-762f-480d-9428-329e99488659:3282:1875807019466880:0@lo:250: 00000100:00100000:2.0:1788909041.381442:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909041.382209:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019466880 00000100:00100000:2.0:1788909041.382221:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019466880 00000100:00100000:2.0:1788909041.382275:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909041.382283:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d527b089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875807019466880:12345-0@lo:250: 00010000:00080000:2.0:1788909041.382315:0:5815:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from de4f34ee-762f-480d-9428-329e99488659@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:2.0:1788909041.382361:0:5815:0:(genops.c:1385:class_connect()) connect: client de4f34ee-762f-480d-9428-329e99488659, cookie 0x733cfdd8721d52e1 00000100:00080000:2.0:1788909041.382506:0:5815:0:(import.c:65:import_set_state_nolock()) 000000004e8a2d56 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788909041.382575:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d527b089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+5:3282:x1875807019466880:12345-0@lo:250: Request processed in 291us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909041.382583:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909041.382640:0:3282:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788909041.382667:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:2.0:1788909041.382675:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788909041.382679:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788909041.382682:0:3282:0:(import.c:65:import_set_state_nolock()) 000000000a9fc563 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788909041.382685:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788909041.382695:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788909041.382699:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ef36ce6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de4f34ee-762f-480d-9428-329e99488659:3282:1875807019466880:0@lo:250: 00000100:00100000:3.0:1788909041.399275:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788909041.399535:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788909041.399543:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788909041.400674:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788909041.400685:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788909041.401238:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788909041.401249:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788909041.402100:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788909041.402474:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788909041.402480:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788909041.403834:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788909041.403845:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788909041.461694:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909041.461951:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788909041.461959:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788909041.464441:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788909041.464458:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788909041.466066:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788909041.466812:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788909041.466842:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788909041.467875:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788909041.467886:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788909041.468856:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909041.469348:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788909041.469363:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788909041.470526:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788909041.470535:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788909041.472437:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788909041.472739:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788909041.472746:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788909041.473710:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788909041.473719:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788909041.497059:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788909041.497549:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788909041.497558:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788909041.500656:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788909041.500675:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788909041.502233:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788909041.502246:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788909041.502950:0:5803:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788909041.502981:0:5803:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788909041.502989:0:5803:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788909041.503154:0:5803:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788909041.503195:0:5803:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788909041.503199:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788909041.503201:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788909041.503202:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788909041.503203:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788909041.503204:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788909041.503205:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788909041.503207:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788909041.503208:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788909041.503210:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788909041.503211:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788909041.503213:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788909041.503214:0:5803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788909041.503222:0:5803:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788909041.503224:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788909041.503225:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788909041.503226:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788909041.503227:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788909041.503228:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788909041.503229:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788909041.503230:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788909041.503231:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788909041.503232:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788909041.503233:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788909041.503234:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788909041.503235:0:5803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788909041.503511:0:5803:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788909041.503545:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095ce7d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467008:0@lo:253: 00000100:00100000:3.0:1788909041.503668:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909041.503777:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb74746d going to sleep for 11 seconds 00000100:00100000:2.0:1788909041.503851:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019467008 00000100:00100000:2.0:1788909041.503859:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019467008 00000100:00100000:2.0:1788909041.503942:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788909041.503953:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077cea5ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+5:5803:x1875807019467008:12345-0@lo:253: 20000000:01000000:2.0:1788909041.504008:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788909041.504011:0:5817:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788909041.504709:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788909041.504768:0:5817:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788909041.505100:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788909041.506180:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788909041.506533:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788909041.506537:0:5817:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788909041.506543:0:5817:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788909041.506546:0:5817:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788909041.506563:0:5817:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788909041.506806:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788909041.507102:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788909041.507594:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788909041.507664:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788909041.507719:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788909041.507757:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788909041.507855:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788909041.507863:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788909041.507944:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788909041.507954:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788909041.507993:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788909041.508000:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788909041.508030:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788909041.508077:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788909041.508217:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788909041.508224:0:5817:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788909041.508244:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788909041.508739:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788909041.508752:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788909041.508796:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788909041.508836:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788909041.508890:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788909041.508908:0:5817:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788909041.509012:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788909041.509023:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788909041.509069:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788909041.509335:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788909041.509385:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788909041.509400:0:5817:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788909041.509517:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788909041.509528:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788909041.509560:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788909041.509596:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788909041.510346:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788909041.510418:0:5817:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788909041.510427:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788909041.511037:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788909041.511592:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788909041.511623:0:5817:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.154@tcp for mdt 20000000:01000000:0.0:1788909041.511625:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788909041.511725:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788909041.511734:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788909041.511763:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788909041.511769:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:0.0:1788909041.511812:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788909041.511821:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788909041.511855:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788909041.511888:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788909041.512093:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788909041.512098:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788909041.512101:0:5817:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788909041.512350:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788909041.512354:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788909041.512385:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788909041.512388:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788909041.512909:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788909041.513247:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788909041.513419:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788909041.513492:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788909041.513505:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788909041.513508:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788909041.513987:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788909041.514371:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788909041.514416:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788909041.514447:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788909041.514464:0:5817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788909041.514467:0:5817:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788909041.514473:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788909041.514477:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788909041.514490:0:5817:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788909041.514499:0:5817:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788909041.516103:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788909041.516500:0:5817:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788909041.529019:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788909041.529102:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788909041.530035:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788909041.530072:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788909041.530103:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530230:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530242:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530248:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530438:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530445:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530451:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2586775 already unused, calling callback (00000000aa77948b) 00010000:00010000:0.0:1788909041.530454:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530461:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530490:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530497:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.530502:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2586775/0x733cfdd8721d52e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788909041.530526:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788909041.864305:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077cea5ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+5:5803:x1875807019467008:12345-0@lo:253: Request processed in 360341us (360624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909041.864350:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788909041.864565:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095ce7d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467008:0@lo:253: 10000000:01000000:2.0:1788909041.864583:0:5803:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788909041.864587:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788909041.864589:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788909041.864590:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909041.864591:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788909041.864592:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909041.864593:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909041.864595:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788909041.864597:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788909041.864598:0:5803:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788909041.864600:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909041.864602:0:5803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788909041.864623:0:5803:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000054ee7130 from lustre-MDT0000 10000000:01000000:2.0:1788909041.864667:0:5803:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788909041.864671:0:5803:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788909041.864676:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff890508884d28 10000000:01000000:2.0:1788909041.864681:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788909041.864690:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff890508884d28 from 1 10000000:01000000:2.0:1788909041.864694:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788909041.864769:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000d77ae18b/0x733cfdd8721d52ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.864781:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000d77ae18b/0x733cfdd8721d52ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.864798:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000d77ae18b/0x733cfdd8721d52ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909041.864820:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467136:0@lo:101: 00000100:00100000:2.0:1788909041.864864:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909041.864981:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1fffe4c going to sleep for 11 seconds 00000100:00100000:0.0:1788909041.865098:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019467136 00000100:00100000:0.0:1788909041.865107:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019467136 00000100:00100000:0.0:1788909041.865224:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788909041.865234:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7424f1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+5:5803:x1875807019467136:12345-0@lo:101: 00010000:00010000:0.0:1788909041.865250:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909041.865267:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2586775/0x733cfdd8721d52f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d52ef expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.865294:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2586775/0x733cfdd8721d52f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d52ef expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.865304:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2586775/0x733cfdd8721d52f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d52ef expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.865315:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2586775, rc 0) 00000100:00100000:0.0:1788909041.865519:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7424f1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+6:5803:x1875807019467136:12345-0@lo:101: Request processed in 287us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909041.865526:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788909041.865604:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467136:0@lo:101: 00010000:00010000:2.0:1788909041.865618:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000d77ae18b/0x733cfdd8721d52ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.865626:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000d77ae18b/0x733cfdd8721d52ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909041.865694:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467264:0@lo:501: 00000100:00100000:2.0:1788909041.865722:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909041.865830:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1fffe4c going to sleep for 11 seconds 00000100:00100000:3.0:1788909041.865917:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019467264 00000100:00100000:3.0:1788909041.865922:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019467264 00000100:00100000:3.0:1788909041.865943:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909041.865948:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b188d463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+6:5803:x1875807019467264:12345-0@lo:501: 00000100:00100000:3.0:1788909041.866228:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b188d463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+6:5803:x1875807019467264:12345-0@lo:501: Request processed in 280us (506us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788909041.866236:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788909041.866315:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467264:0@lo:501: 10000000:01000000:2.0:1788909041.866351:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788909041.866369:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000d77ae18b/0x733cfdd8721d52ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.866376:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000d77ae18b/0x733cfdd8721d52ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909041.866384:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8905103af000 10000000:01000000:2.0:1788909041.866388:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788909041.866398:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8905103af000 10000000:01000000:2.0:1788909041.866400:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788909041.866403:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8905103af000 from 1 10000000:01000000:2.0:1788909041.866405:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788909041.866424:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 0000000052e6ce35/0x733cfdd8721d52fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.866431:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 0000000052e6ce35/0x733cfdd8721d52fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.866438:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 0000000052e6ce35/0x733cfdd8721d52fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909041.866449:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467392:0@lo:101: 00000100:00100000:2.0:1788909041.866475:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909041.866492:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1fffe4c going to sleep for 11 seconds 00000100:00100000:3.0:1788909041.866681:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019467392 00000100:00100000:3.0:1788909041.866687:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019467392 00000100:00100000:3.0:1788909041.866710:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788909041.866716:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f76e15c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+6:5803:x1875807019467392:12345-0@lo:101: 00010000:00010000:3.0:1788909041.866724:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909041.866735:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a0daf3c/0x733cfdd8721d5304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d52fd expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909041.866750:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a0daf3c/0x733cfdd8721d5304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d52fd expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909041.866757:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a0daf3c/0x733cfdd8721d5304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d52fd expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909041.866765:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a0daf3c, rc 0) 00000100:00100000:3.0:1788909041.866799:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f76e15c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+7:5803:x1875807019467392:12345-0@lo:101: Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909041.866804:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788909041.866880:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467392:0@lo:101: 00010000:00010000:2.0:1788909041.866891:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 0000000052e6ce35/0x733cfdd8721d52fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.866898:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 0000000052e6ce35/0x733cfdd8721d52fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909041.866908:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788909041.866992:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 0000000052e6ce35/0x733cfdd8721d52fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.866998:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 0000000052e6ce35/0x733cfdd8721d52fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909041.867015:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788909041.867018:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788909041.867022:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8905103af000 10000000:01000000:2.0:1788909041.867024:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788909041.867027:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788909041.867028:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788909041.867043:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000002e8de3fc/0x733cfdd8721d530b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.867048:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000002e8de3fc/0x733cfdd8721d530b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.867054:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000002e8de3fc/0x733cfdd8721d530b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909041.867064:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467520:0@lo:101: 00000100:00100000:2.0:1788909041.867088:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909041.867104:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1fffe4c going to sleep for 11 seconds 00000100:00100000:0.0:1788909041.867181:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019467520 00000100:00100000:0.0:1788909041.867191:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019467520 00000100:00100000:0.0:1788909041.867211:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788909041.867216:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0d837e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+7:5803:x1875807019467520:12345-0@lo:101: 00010000:00010000:0.0:1788909041.867223:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909041.867230:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d62d2ee8/0x733cfdd8721d5312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d530b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.867242:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d62d2ee8/0x733cfdd8721d5312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d530b expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.867249:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d62d2ee8/0x733cfdd8721d5312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d530b expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909041.867255:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d62d2ee8, rc 0) 00000100:00100000:0.0:1788909041.867281:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0d837e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+8:5803:x1875807019467520:12345-0@lo:101: Request processed in 65us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909041.867286:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788909041.867441:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467520:0@lo:101: 00010000:00010000:2.0:1788909041.867450:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000002e8de3fc/0x733cfdd8721d530b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909041.867456:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000002e8de3fc/0x733cfdd8721d530b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909041.867507:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467648:0@lo:501: 00000100:00100000:2.0:1788909041.867532:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909041.867567:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1fffe4c going to sleep for 11 seconds 00000100:00100000:0.0:1788909041.867687:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019467648 00000100:00100000:0.0:1788909041.867692:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019467648 00000100:00100000:0.0:1788909041.867710:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788909041.867714:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054cbaf26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+8:5803:x1875807019467648:12345-0@lo:501: 00000100:00100000:0.0:1788909041.867920:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054cbaf26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+9:5803:x1875807019467648:12345-0@lo:501: Request processed in 205us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909041.867927:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788909041.867999:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467648:0@lo:501: 00000100:00100000:2.0:1788909041.868025:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467776:0@lo:503: 00000100:00100000:2.0:1788909041.868058:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909041.868078:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1fffe4c going to sleep for 11 seconds 00000100:00100000:0.0:1788909041.869987:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019467776 00000100:00100000:0.0:1788909041.870004:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019467776 00000100:00100000:0.0:1788909041.870057:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788909041.870066:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000aacbf0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+9:5803:x1875807019467776:12345-0@lo:503: 00000100:00100000:0.0:1788909041.870588:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000aacbf0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+9:5803:x1875807019467776:12345-0@lo:503: Request processed in 522us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909041.870606:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788909041.870748:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019467776:0@lo:503: 00000100:00100000:3.0:1788909041.871483:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b0c5038 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:5845:1875807019467904:0@lo:502: 00000100:00100000:3.0:1788909041.871541:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909041.871583:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b239f87 going to sleep for 11 seconds 00000100:00100000:2.0:1788909041.871630:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019467904 00000100:00100000:2.0:1788909041.871646:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019467904 00000100:00100000:2.0:1788909041.871675:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788909041.871683:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dde6eef4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+9:5845:x1875807019467904:12345-0@lo:502: 00000100:00100000:2.0:1788909041.871879:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dde6eef4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+9:5845:x1875807019467904:12345-0@lo:502: Request processed in 197us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909041.871886:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788909041.872012:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b0c5038 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:5845:1875807019467904:0@lo:502: 00000020:01000000:3.0:1788909041.872037:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909041.872047:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909041.872050:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788909041.872054:0:5845:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788909041.872056:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788909041.872068:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000e1e9e56) 00000020:00000080:3.0:1788909041.872083:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788909041.872088:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788909041.872197:0:5845:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788909041.872208:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d5320 00000020:00000080:3.0:1788909041.873695:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788909041.873706:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909041.873712:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909041.873715:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788909041.873718:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909041.873723:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909041.873724:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788909041.873728:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788909041.873746:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008773924f) 00000020:00000080:3.0:1788909041.873766:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788909041.873771:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788909041.873773:0:5845:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788909041.873776:0:5845:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788909041.873782:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788909041.873848:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000054ee7130 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788909041.873860:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004aefd066) 00000020:00000080:3.0:1788909041.873868:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788909041.873914:0:5845:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788909041.873920:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d5335 00000020:00000080:3.0:1788909041.874009:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788909041.874015:0:5845:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788909041.874019:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x733cfdd8721d533c 00080000:01000000:3.0:1788909041.874025:0:5845:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788909041.874029:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d5343 00080000:10000000:3.0:1788909041.876414:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788909041.876713:0:5845:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788909041.885761:0:5845:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788909041.987099:0:5845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788909041.987661:0:5845:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788909041.993838:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788909041.994289:0:5845:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788909042.033056:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000003150e342) 00000020:00000080:1.0:1788909042.033090:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788909042.033245:0:5845:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788909042.033252:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d5351 00000020:00000080:3.0:1788909042.036705:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788909042.038209:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788909042.078950:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788909042.107078:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909042.185900:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909042.291721:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788909042.334489:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788909042.371508:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x733cfdd8721d5358 00000020:00000080:3.0:1788909042.372173:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788909042.372195:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909042.372201:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909042.372204:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788909042.372207:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909042.372211:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909042.372212:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788909042.372215:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788909042.372217:0:5845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788909042.372219:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909042.372221:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909042.372222:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788909042.372224:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909042.372229:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909042.372230:0:5845:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788909042.372234:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788909042.372277:0:5845:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788909042.372450:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b0c5038 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:5845:1875807019468032:0@lo:502: 00000100:00100000:3.0:1788909042.372536:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909042.372663:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b239f87 going to sleep for 11 seconds 00010000:00010000:3.0:1788909042.373586:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909042.374267:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019468032 00000100:00100000:0.0:1788909042.374281:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019468032 00000100:00100000:0.0:1788909042.374358:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788909042.374367:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015a3c2d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+9:5845:x1875807019468032:12345-0@lo:502: 00000100:00100000:0.0:1788909042.374853:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015a3c2d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+9:5845:x1875807019468032:12345-0@lo:502: Request processed in 485us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909042.374863:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788909042.375431:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b0c5038 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:5845:1875807019468032:0@lo:502: 00000020:01000000:3.0:1788909042.375476:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909042.375485:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909042.375489:0:5845:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788909042.375494:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788909042.376286:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788909042.376331:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788909042.376352:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000002e8de3fc/0x733cfdd8721d530b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.376367:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000002e8de3fc/0x733cfdd8721d530b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909042.376377:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8905103af000 from 1 10000000:01000000:2.0:1788909042.376380:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788909042.376435:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.376459:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.376472:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909042.376502:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468160:0@lo:101: 00000100:00100000:2.0:1788909042.376574:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909042.376643:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f107e90 going to sleep for 11 seconds 00000100:00100000:1.0:1788909042.376765:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019468160 00000100:00100000:1.0:1788909042.376774:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019468160 00000100:00100000:1.0:1788909042.376827:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788909042.376837:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009119efee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+9:5803:x1875807019468160:12345-0@lo:101: 00010000:00010000:1.0:1788909042.376865:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909042.376882:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d535f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909042.376908:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d535f expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909042.376919:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d535f expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909042.376928:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040e5a709, rc 0) 00000100:00100000:1.0:1788909042.376977:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009119efee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+10:5803:x1875807019468160:12345-0@lo:101: Request processed in 141us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909042.376984:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788909042.377283:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468160:0@lo:101: 00010000:00010000:2.0:1788909042.377301:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.377418:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909042.377996:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468288:0@lo:256: 00000100:00100000:2.0:1788909042.378066:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909042.378215:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f107e90 going to sleep for 11 seconds 00000100:00100000:0.0:1788909042.378502:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019468288 00000100:00100000:0.0:1788909042.378511:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019468288 00000100:00100000:0.0:1788909042.378612:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788909042.378622:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046c4322b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+10:5803:x1875807019468288:12345-0@lo:256: 20000000:01000000:0.0:1788909042.378660:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788909042.378669:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788909042.378776:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046c4322b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+10:5803:x1875807019468288:12345-0@lo:256: Request processed in 156us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909042.378784:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788909042.378896:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468288:0@lo:256: 10000000:01000000:2.0:1788909042.379859:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788909042.379930:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.379944:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909042.379974:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905103af000 from 1 10000000:01000000:2.0:1788909042.379977:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788909042.380012:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.380019:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.380028:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909042.380051:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468416:0@lo:101: 00000100:00100000:2.0:1788909042.380259:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909042.380356:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f107e90 going to sleep for 11 seconds 00000100:00100000:0.0:1788909042.380527:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019468416 00000100:00100000:0.0:1788909042.380537:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019468416 00000100:00100000:0.0:1788909042.380605:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788909042.380615:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ff3c76f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+10:5803:x1875807019468416:12345-0@lo:101: 00010000:00010000:0.0:1788909042.380641:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909042.380656:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d536d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909042.380679:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d536d expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909042.380701:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d536d expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909042.380710:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000762e5f6a, rc 0) 00000100:00100000:0.0:1788909042.380803:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ff3c76f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+11:5803:x1875807019468416:12345-0@lo:101: Request processed in 189us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909042.380822:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788909042.381145:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468416:0@lo:101: 00010000:00010000:2.0:1788909042.381164:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.381174:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909042.381246:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468544:0@lo:501: 00000100:00100000:2.0:1788909042.381279:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909042.381486:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f107e90 going to sleep for 11 seconds 00000100:00100000:0.0:1788909042.381531:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019468544 00000100:00100000:0.0:1788909042.381536:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019468544 00000100:00100000:3.0:1788909042.381676:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788909042.381683:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087202cbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+11:5803:x1875807019468544:12345-0@lo:501: 00000100:00100000:3.0:1788909042.382426:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087202cbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+11:5803:x1875807019468544:12345-0@lo:501: Request processed in 741us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909042.382437:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788909042.382452:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468544:0@lo:501: 00000100:00100000:2.0:1788909042.382492:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468672:0@lo:503: 00000100:00100000:2.0:1788909042.382545:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909042.382579:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f107e90 going to sleep for 11 seconds 00000100:00100000:1.0:1788909042.382652:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019468672 00000100:00100000:1.0:1788909042.382659:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019468672 00000100:00100000:1.0:1788909042.382737:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788909042.382746:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003856fb78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:5803:x1875807019468672:12345-0@lo:503: 00000040:00080000:1.0:1788909042.382785:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788909042.382845:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003856fb78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:5803:x1875807019468672:12345-0@lo:503: Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909042.382853:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788909042.382923:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468672:0@lo:503: 00000040:00080000:2.0:1788909042.384137:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788909042.384402:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788909042.384433:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788909042.384457:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909042.384468:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909042.384514:0:5803:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788909042.384517:0:5803:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8905103af000 10000000:01000000:3.0:1788909042.384521:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8905103af000 10000000:01000000:3.0:1788909042.384526:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788909042.384532:0:5803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905103af000 from 1 10000000:01000000:3.0:1788909042.384535:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788909042.384576:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000337ff6dd/0x733cfdd8721d537b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909042.384584:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000337ff6dd/0x733cfdd8721d537b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909042.384593:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000337ff6dd/0x733cfdd8721d537b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909042.384612:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b0c5038 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468800:0@lo:101: 00000100:00100000:3.0:1788909042.384674:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909042.384710:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098623f7e going to sleep for 11 seconds 00000100:00100000:2.0:1788909042.384882:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019468800 00000100:00100000:2.0:1788909042.384892:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019468800 00000100:00100000:2.0:1788909042.385020:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788909042.385031:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e661908f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+11:5803:x1875807019468800:12345-0@lo:101: 00010000:00010000:2.0:1788909042.385046:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909042.385300:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d19c1b5b/0x733cfdd8721d5382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d537b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.385327:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d19c1b5b/0x733cfdd8721d5382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d537b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.385336:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d19c1b5b/0x733cfdd8721d5382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d537b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.385344:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d19c1b5b, rc 0) 00000100:00100000:2.0:1788909042.385392:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e661908f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+12:5803:x1875807019468800:12345-0@lo:101: Request processed in 363us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909042.385399:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909042.385503:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b0c5038 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468800:0@lo:101: 00010000:00010000:3.0:1788909042.385520:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000337ff6dd/0x733cfdd8721d537b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909042.385551:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000337ff6dd/0x733cfdd8721d537b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909042.385612:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b0c5038 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468928:0@lo:501: 00000100:00100000:3.0:1788909042.385657:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909042.385688:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098623f7e going to sleep for 11 seconds 00000100:00100000:1.0:1788909042.385741:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019468928 00000100:00100000:1.0:1788909042.385748:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019468928 00000100:00100000:1.0:1788909042.385823:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788909042.385831:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf8644f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:5803:x1875807019468928:12345-0@lo:501: 00000100:00100000:1.0:1788909042.386180:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf8644f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:5803:x1875807019468928:12345-0@lo:501: Request processed in 349us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909042.386196:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788909042.386342:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b0c5038 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019468928:0@lo:501: 00000100:00100000:2.0:1788909042.386373:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019469056:0@lo:503: 00000100:00100000:2.0:1788909042.386411:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909042.387515:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eeead8c5 going to sleep for 11 seconds 00000100:00100000:0.0:1788909042.387577:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019469056 00000100:00100000:0.0:1788909042.387587:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019469056 00000100:00100000:0.0:1788909042.387639:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788909042.387647:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0db416c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:5803:x1875807019469056:12345-0@lo:503: 00000100:00100000:1.0:1788909042.388715:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0db416c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:5803:x1875807019469056:12345-0@lo:503: Request processed in 1067us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909042.388726:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788909042.388814:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbcf0c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019469056:0@lo:503: 00000100:00100000:1.0:1788909042.389535:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012d2d471 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:5850:1875807019469184:0@lo:502: 00000100:00100000:1.0:1788909042.389681:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909042.389754:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f31b9ae9 going to sleep for 11 seconds 00000100:00100000:3.0:1788909042.389798:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019469184 00000100:00100000:3.0:1788909042.389805:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019469184 00000100:00100000:3.0:1788909042.389849:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788909042.389857:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057c5eca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:5850:x1875807019469184:12345-0@lo:502: 00000100:00100000:3.0:1788909042.393737:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057c5eca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:5850:x1875807019469184:12345-0@lo:502: Request processed in 3865us (4041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909042.393757:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788909042.394007:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012d2d471 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:5850:1875807019469184:0@lo:502: 00000020:01000004:1.0:1788909042.394764:0:5850:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788909042.394783:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003e9c1f17) 00000020:00000080:1.0:1788909042.394805:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788909042.394935:0:5850:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000054ee7130 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788909042.394940:0:5850:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000054ee7130 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788909042.394943:0:5850:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000054ee7130 4 00010000:00080000:1.0:1788909042.394988:0:5850:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006ca28a19@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788909042.400653:0:5850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788909042.400970:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788909042.401007:0:5850:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788909042.401023:0:5850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x733cfdd8721d5390 00000100:00080000:1.0:1788909042.401034:0:5850:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788909042.401038:0:5850:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006ca28a19 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788909042.401088:0:5850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000012d2d471 x1875807019469312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788909042.401142:0:5850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788909042.401485:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a693b97a pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:5850:1875807019469440:0@lo:502: 00000100:00100000:1.0:1788909042.401584:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909042.401650:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019469440 00000100:00100000:1.0:1788909042.401658:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019469440 00000100:00100000:1.0:1788909042.401703:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788909042.401711:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001db73a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:5850:x1875807019469440:12345-0@lo:502: 00000100:00100000:1.0:1788909042.401966:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001db73a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:5850:x1875807019469440:12345-0@lo:502: Request processed in 255us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909042.401975:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788909042.402041:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 000000008175ad84 going to sleep for 11 seconds 00000100:00100000:1.0:1788909042.402064:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a693b97a pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:5850:1875807019469440:0@lo:502: 00000040:00080000:1.0:1788909042.402092:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1788909042.402393:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012d2d471 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019469312:0@lo:38: 00000100:00100000:2.0:1788909042.402446:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788909042.402488:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788909042.402505:0:5803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788909042.402517:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000337ff6dd/0x733cfdd8721d537b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.402529:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000337ff6dd/0x733cfdd8721d537b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788909042.402581:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788909042.402584:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788909042.402586:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909042.402587:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909042.402588:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909042.402589:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909042.402591:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788909042.402592:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788909042.402594:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788909042.402595:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788909042.402596:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909042.402597:0:5803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788909042.402601:0:5803:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788909042.402603:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788909042.402605:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788909042.402606:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909042.402607:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909042.402608:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909042.402609:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909042.402610:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788909042.402611:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788909042.402611:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788909042.402612:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788909042.402613:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909042.402614:0:5803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788909042.402644:0:5803:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788909042.402660:0:5803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067ec8c1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019469568:0@lo:253: 00000100:00100000:2.0:1788909042.402713:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909042.402749:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019469568 00000100:00100000:2.0:1788909042.402755:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019469568 00000100:00100000:2.0:1788909042.402783:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788909042.402788:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bc8693e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:5803:x1875807019469568:12345-0@lo:253: 20000000:01000000:2.0:1788909042.402809:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788909042.402822:0:5817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788909042.403932:0:5803:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f107e90 going to sleep for 11 seconds 00000100:00100000:1.0:1788909042.404639:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019469312 00000100:00100000:1.0:1788909042.404648:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019469312 00000100:00100000:1.0:1788909042.404685:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788909042.404692:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbcf0c7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875807019469312:12345-0@lo:38: 00000100:00100000:1.0:1788909042.404778:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbcf0c7f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875807019469312:12345-0@lo:38: Request processed in 85us (2332us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788909042.404785:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788909042.404840:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788909042.404849:0:3282:0:(import.c:65:import_set_state_nolock()) 000000006ca28a19 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788909042.404853:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788909042.404856:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012d2d471 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019469312:0@lo:38: 20000000:01000000:0.0:1788909042.439075:0:5817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788909042.439092:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788909042.442521:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788909042.442532:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788909042.442559:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.442578:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d535f expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.442586:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.442639:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d535f expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.442658:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d535f expref: 12 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909042.442670:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5750abb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875807019469696:0@lo:104: 00000100:00100000:2.0:1788909042.442748:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909042.442805:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d1a663c5 going to sleep for 11 seconds 00000100:00100000:1.0:1788909042.443209:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019469696 00000100:00100000:1.0:1788909042.443217:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019469696 00000100:00100000:1.0:1788909042.443265:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788909042.443273:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c87f56c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+3:5838:x1875807019469696:12345-0@lo:104: 00010000:00010000:1.0:1788909042.443285:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909042.443364:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788909042.443369:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c87f56c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+3:5838:x1875807019469696:12345-0@lo:104: Request processed in 98us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909042.443376:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909042.443514:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5750abb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875807019469696:0@lo:104: 00010000:00010000:2.0:1788909042.443584:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.443601:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909042.443605:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.443612:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001091c734 already unused, calling callback (0000000037fbcd79) 10000000:00010000:2.0:1788909042.443615:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.443621:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909042.443638:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909042.443643:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909042.443670:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.443798:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788909042.443924:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5750abb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019469824:0@lo:103: 00000100:00100000:1.0:1788909042.443960:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788909042.444015:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444023:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000001091c734/0x733cfdd8721d535f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5366 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444039:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909042.444041:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909042.444042:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909042.444079:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019469824 00000100:00100000:2.0:1788909042.444085:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019469824 00010000:00010000:2.0:1788909042.444105:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d535f expref: 13 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909042.444150:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909042.444157:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012d2d471 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+13:3284:x1875807019469824:12345-0@lo:103: 00010000:00010000:2.0:1788909042.444167:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909042.444172:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d535f expref: 13 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444181:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d535f expref: 13 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444193:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000040e5a709/0x733cfdd8721d5366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d535f expref: 13 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444205:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444212:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788909042.444224:0:5807:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001692949s 00010000:00010000:2.0:1788909042.444227:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444233:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444239:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444253:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444258:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cf5e103c already unused, calling callback (00000000aa77948b) 00010000:00010000:2.0:1788909042.444261:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444267:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444279:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444287:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909042.444557:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012d2d471 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+12:3284:x1875807019469824:12345-0@lo:103: Request processed in 401us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909042.444566:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788909042.444636:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444643:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909042.444649:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cf5e103c/0x733cfdd8721d5397 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909042.446347:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5750abb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019469824:0@lo:103: 00000100:00100000:1.0:1788909042.452335:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bc8693e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:5803:x1875807019469568:12345-0@lo:253: Request processed in 49538us (49612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909042.452352:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788909042.452542:0:5803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067ec8c1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:5803:1875807019469568:0@lo:253: 10000000:01000000:2.0:1788909042.452559:0:5803:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788909042.452563:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788909042.452580:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788909042.452582:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909042.452583:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909042.452584:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909042.452585:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909042.452586:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788909042.452587:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788909042.452589:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788909042.452590:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788909042.452591:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909042.452593:0:5803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788909042.452607:0:5803:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788909042.458782:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909042.459470:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909042.460102:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909042.460529:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909042.460863:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909042.461061:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909042.462087:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909042.462499:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909042.462819:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909042.462987:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909042.463226:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909042.463580:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788909042.502212:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788909042.540999:0:5803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788909042.541391:0:5855:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788909042.541395:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788909042.541457:0:5856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788909042.550819:0:5803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788909042.551024:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788909042.557899:0:5803:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788909042.557945:0:5803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788909042.558296:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788909042.559315:0:5803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788909042.559869:0:5803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788909042.559904:0:5803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788909042.567351:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788909042.567647:0:5803:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788909042.569045:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788909042.569271:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788909042.569425:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788909042.569569:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788909042.569822:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788909042.569971:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788909042.574810:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788909042.575665:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788909042.575856:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788909042.576091:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788909042.577017:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788909042.577259:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788909042.578047:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788909042.578242:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788909042.578603:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788909042.578760:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788909042.579051:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788909042.579557:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788909042.580185:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788909042.580340:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788909042.580691:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788909042.580842:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788909042.581583:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788909042.581753:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788909042.581912:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788909042.583728:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788909042.587726:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788909042.588013:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788909042.592294:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788909042.596894:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788909042.597246:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788909042.597999:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788909042.598296:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788909042.614671:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788909042.667545:0:5803:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788909042.667596:0:5803:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa608c1c87988 00100000:10000000:3.0:1788909042.667608:0:5803:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:2.0:1788909042.668941:0:5856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788909042.669042:0:5856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788909042.669046:0:5856:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:3.0:1788909042.669927:0:5803:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788909042.669945:0:5803:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788909042.669963:0:5803:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788909042.669981:0:5803:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788909043.397274:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909044.421700:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909045.447801:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909046.469497:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788909046.896144:0:6099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788909047.429351:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788909047.429362:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788909047.429365:0:36:0:(import.c:65:import_set_state_nolock()) 000000006ca28a19 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788909047.429377:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006ca28a19 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788909047.429400:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e02a4121 x1875807019470080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788909047.429585:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e02a4121 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019470080:0@lo:38: 00000100:00100000:2.0:1788909047.429651:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909047.431161:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019470080 00000100:00100000:0.0:1788909047.431174:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019470080 00000100:00100000:0.0:1788909047.431234:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788909047.431242:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067ec8c1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875807019470080:12345-0@lo:38: 00010000:00080000:0.0:1788909047.431285:0:5824:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:0.0:1788909047.431327:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x733cfdd8721d539e 00000004:00100000:0.0:1788909047.431374:0:5824:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788909047.431484:0:5824:0:(import.c:65:import_set_state_nolock()) 00000000e166d048 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788909047.431566:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067ec8c1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875807019470080:12345-0@lo:38: Request processed in 324us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909047.431572:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788909047.431742:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e02a4121 x1875807019470080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788909057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788909047.431761:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788909047.431769:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788909047.431773:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788909047.431775:0:3282:0:(import.c:65:import_set_state_nolock()) 000000006ca28a19 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788909047.431782:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e02a4121 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019470080:0@lo:38: 00000100:00100000:3.0:1788909047.434917:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000195ef7f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019469952:0@lo:400: 00000100:00100000:3.0:1788909047.435007:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909047.436507:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019469952 00000100:00100000:2.0:1788909047.436521:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019469952 00000100:00100000:2.0:1788909047.436597:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788909047.436607:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3c359db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+11:3285:x1875807019469952:12345-0@lo:400: 00000100:00100000:2.0:1788909047.436799:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3c359db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+11:3285:x1875807019469952:12345-0@lo:400: Request processed in 193us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909047.436807:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788909047.437066:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000195ef7f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019469952:0@lo:400: 00010000:00010000:0.0:1788909047.493579:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909048.517818:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788909048.966035:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788909048.966044:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8905103af000 from 3 10000000:01000000:2.0:1788909048.966049:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788909048.966099:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000cf5e103c/0x733cfdd8721d53a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909048.966141:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000cf5e103c/0x733cfdd8721d53a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909048.966151:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000cf5e103c/0x733cfdd8721d53a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909048.966189:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a4e5d9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019470208:0@lo:101: 00000100:00100000:2.0:1788909048.966254:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909048.966316:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057e9cc20 going to sleep for 11 seconds 00000100:00100000:1.0:1788909048.967410:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019470208 00000100:00100000:1.0:1788909048.967422:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019470208 00000100:00100000:1.0:1788909048.967490:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788909048.967509:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2e49b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:5820:x1875807019470208:12345-0@lo:101: 00010000:00010000:1.0:1788909048.967525:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909048.967542:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005eac72c9/0x733cfdd8721d53ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d53a5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909048.967568:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005eac72c9/0x733cfdd8721d53ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d53a5 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909048.967577:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005eac72c9/0x733cfdd8721d53ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d53a5 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909048.967586:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005eac72c9, rc 0) 00000100:00100000:1.0:1788909048.967678:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2e49b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019470208:12345-0@lo:101: Request processed in 181us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909048.967685:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788909048.967796:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a4e5d9c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019470208:0@lo:101: 00010000:00010000:3.0:1788909048.967813:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000cf5e103c/0x733cfdd8721d53a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909048.967821:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000cf5e103c/0x733cfdd8721d53a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909048.967893:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d42ab1c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019470336:0@lo:256: 00000100:00100000:3.0:1788909048.967932:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909048.967968:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad91b8cb going to sleep for 11 seconds 00000100:00100000:2.0:1788909048.969161:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019470336 00000100:00100000:2.0:1788909048.969172:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019470336 00000100:00100000:2.0:1788909048.969236:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788909048.969245:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b549fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019470336:12345-0@lo:256: 20000000:01000000:2.0:1788909048.969271:0:5815:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788909048.969295:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788909048.969298:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788909048.969428:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b549fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019470336:12345-0@lo:256: Request processed in 182us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909048.969436:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788909048.969842:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d42ab1c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019470336:0@lo:256: 10000000:01000000:3.0:1788909048.969924:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788909048.969934:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: 00000000cf5e103c/0x733cfdd8721d53a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909048.969944:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: 00000000cf5e103c/0x733cfdd8721d53a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909049.541395:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909050.568783:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909051.605197:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788909051.948660:0:6301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceca2f230 20000000:00000080:2.0:1788909051.948683:0:6301:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890534074800 uarg=0000000000000000 20000000:01000000:2.0:1788909051.948901:0:6301:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788909051.948910:0:6301:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788909051.948915:0:6301:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788909051.949576:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788909051.949590:0:6301:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788909051.954818:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788909051.955083:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788909051.955360:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788909051.955405:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788909051.955424:0:6301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788909051.955453:0:6301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.955471:0:6301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d536d expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.955486:0:6301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.955525:0:6301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d536d expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.955538:0:6301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d536d expref: 11 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909051.955553:0:6301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b062a20e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1875807019470464:0@lo:104: 00000100:00100000:2.0:1788909051.955622:0:6301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909051.955678:0:6301:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de9640f6 going to sleep for 11 seconds 00000100:00100000:3.0:1788909051.956049:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019470464 00000100:00100000:3.0:1788909051.956059:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019470464 00000100:00100000:3.0:1788909051.956132:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788909051.956210:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efebc55f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:6301:x1875807019470464:12345-0@lo:104: 00010000:00010000:3.0:1788909051.956222:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909051.956284:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788909051.956289:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efebc55f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:6301:x1875807019470464:12345-0@lo:104: Request processed in 82us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909051.956295:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788909051.956388:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909051.956393:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909051.956400:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001370fe1b already unused, calling callback (0000000037fbcd79) 10000000:00010000:0.0:1788909051.956403:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909051.956409:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909051.956415:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909051.956420:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788909051.956501:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909051.956508:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909051.956544:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909051.956550:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: 000000001370fe1b/0x733cfdd8721d536d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5374 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909051.956565:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909051.956567:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909051.956568:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909051.956650:0:6301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b062a20e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1875807019470464:0@lo:104: 00010000:00010000:2.0:1788909051.956670:0:6301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909051.956712:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909051.956779:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006e8144e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019470592:0@lo:103: 00000100:00100000:3.0:1788909051.956813:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909051.956939:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019470592 00000100:00100000:2.0:1788909051.956945:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019470592 00010000:00010000:2.0:1788909051.956966:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d536d expref: 12 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909051.957090:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788909051.957098:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d42ab1c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+12:3285:x1875807019470592:12345-0@lo:103: 00010000:00010000:2.0:1788909051.957168:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909051.957174:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d536d expref: 12 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957185:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d536d expref: 12 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957210:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000762e5f6a/0x733cfdd8721d5374 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d536d expref: 12 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957224:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957231:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957245:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957252:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957257:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957262:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957267:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000680acc30 already unused, calling callback (00000000aa77948b) 00010000:00010000:2.0:1788909051.957269:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957275:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957288:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909051.957308:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909051.957461:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d42ab1c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+11:3285:x1875807019470592:12345-0@lo:103: Request processed in 363us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909051.957469:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788909051.957539:0:6301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909051.957548:0:6301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909051.957554:0:6301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000680acc30/0x733cfdd8721d53b3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909051.960256:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006e8144e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019470592:0@lo:103: 00000100:00100000:2.0:1788909052.549482:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788909052.549511:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b062a20e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019470720:0@lo:400: 00000100:00100000:2.0:1788909052.549589:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909052.549674:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019470720 00000100:00100000:2.0:1788909052.549683:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019470720 00000100:00100000:2.0:1788909052.549751:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909052.549762:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdbd7f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019470720:12345-0@lo:400: 00000100:00100000:2.0:1788909052.549822:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdbd7f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019470720:12345-0@lo:400: Request processed in 63us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909052.549830:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788909052.549871:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b062a20e x1875807019470720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909052.549885:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b062a20e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019470720:0@lo:400: 00010000:00010000:1.0:1788909052.613393:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909053.637711:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909054.666253:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909055.685361:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909056.709237:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788909057.669223:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788909057.669232:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905103af000 from 1 10000000:01000000:3.0:1788909057.669237:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788909057.669282:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: 00000000036725f2/0x733cfdd8721d53ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909057.669295:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: 00000000036725f2/0x733cfdd8721d53ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909057.669319:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: 00000000036725f2/0x733cfdd8721d53ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909057.669355:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000759ed04d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019470848:0@lo:101: 00000100:00100000:3.0:1788909057.669432:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909057.669572:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b062a20e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019470976:0@lo:400: 00000100:00100000:2.0:1788909057.669607:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909057.669945:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019470976 00000100:00100000:0.0:1788909057.669961:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019470976 00000100:00100000:0.0:1788909057.670368:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788909057.670376:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4732b27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019470976:12345-0@lo:400: 00000100:00100000:0.0:1788909057.670439:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4732b27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019470976:12345-0@lo:400: Request processed in 64us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909057.670445:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788909057.670469:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019470848 00000100:00100000:0.0:1788909057.670481:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019470848 00000100:00100000:3.0:1788909057.670570:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031632f8c going to sleep for 11 seconds 00000100:00100000:0.0:1788909057.671241:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788909057.671263:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039d10a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:5820:x1875807019470848:12345-0@lo:101: 00010000:00010000:0.0:1788909057.671276:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909057.671291:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001b7fff6d/0x733cfdd8721d53c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d53ba expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909057.671324:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b7fff6d/0x733cfdd8721d53c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d53ba expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909057.671350:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001b7fff6d/0x733cfdd8721d53c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d53ba expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909057.671358:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001b7fff6d, rc 0) 00000100:00100000:0.0:1788909057.671402:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039d10a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019470848:12345-0@lo:101: Request processed in 141us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909057.671408:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788909057.671516:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b062a20e x1875807019470976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909057.671533:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b062a20e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019470976:0@lo:400: 00000100:00100000:0.0:1788909057.672741:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000759ed04d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019470848:0@lo:101: 00010000:00010000:0.0:1788909057.672764:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: 00000000036725f2/0x733cfdd8721d53ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909057.672775:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: 00000000036725f2/0x733cfdd8721d53ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909057.674223:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080988d5e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019471104:0@lo:501: 00000100:00100000:0.0:1788909057.674323:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909057.674399:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5a66345 going to sleep for 11 seconds 00000100:00100000:0.0:1788909057.674429:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019471104 00000100:00100000:0.0:1788909057.674436:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019471104 00000100:00100000:0.0:1788909057.674480:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788909057.674498:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ce586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019471104:12345-0@lo:501: 00000100:00100000:0.0:1788909057.678806:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ce586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019471104:12345-0@lo:501: Request processed in 4309us (4493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909057.678822:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788909057.678832:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080988d5e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019471104:0@lo:501: 00000100:00100000:3.0:1788909057.678891:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000022cba9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019471232:0@lo:503: 00000100:00100000:3.0:1788909057.678958:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909057.678997:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084ceaa5e going to sleep for 11 seconds 00000100:00100000:0.0:1788909057.681535:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019471232 00000100:00100000:0.0:1788909057.681565:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019471232 00000100:00100000:0.0:1788909057.681657:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788909057.681668:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf845509 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019471232:12345-0@lo:503: 00000100:00100000:0.0:1788909057.684801:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf845509 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019471232:12345-0@lo:503: Request processed in 3128us (5836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909057.684817:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788909057.687161:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000022cba9a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019471232:0@lo:503: 00000100:00100000:2.0:1788909057.688404:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009138082 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:6672:1875807019471360:0@lo:502: 00000100:00100000:2.0:1788909057.688493:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909057.688552:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0aa846c going to sleep for 11 seconds 00000100:00100000:3.0:1788909057.688649:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019471360 00000100:00100000:3.0:1788909057.688656:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019471360 00000100:00100000:3.0:1788909057.688708:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788909057.688716:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8fc2875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:6672:x1875807019471360:12345-0@lo:502: 00000100:00100000:3.0:1788909057.688927:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8fc2875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:6672:x1875807019471360:12345-0@lo:502: Request processed in 212us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909057.688935:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788909057.688982:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009138082 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:6672:1875807019471360:0@lo:502: 00000020:01000000:3.0:1788909057.689008:0:6672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909057.689017:0:6672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909057.689019:0:6672:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788909057.689036:0:6672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8905103af000 00000020:00000080:3.0:1788909057.689039:0:6672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788909057.689076:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:6672:1875807019471488:0@lo:502: 00000100:00100000:3.0:1788909057.689125:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909057.689158:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff890503fc8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788909057.691771:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019471488 00000100:00100000:2.0:1788909057.691786:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019471488 00000100:00100000:2.0:1788909057.691847:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788909057.691882:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:6672:x1875807019471488:12345-0@lo:502: 00000100:00100000:2.0:1788909057.692184:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:6672:x1875807019471488:12345-0@lo:502: Request processed in 304us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909057.692192:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788909057.692231:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:6672:1875807019471488:0@lo:502: 00000020:01000000:0.0:1788909057.692306:0:6672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909057.692314:0:6672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909057.692316:0:6672:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788909057.692321:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788909057.692926:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788909057.692959:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788909057.692970:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909057.692985:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909057.733341:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788909057.955865:0:6670:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788909057.955870:0:6670:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788909057.956009:0:6670:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8905068d9800 00000020:01000004:0.0:1788909057.956106:0:6670:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788909057.956212:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788909057.956227:0:6670:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff890518373370) 00000020:00000080:0.0:1788909057.956259:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788909057.974705:0:6670:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788909057.975227:0:6670:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788909058.004029:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788909058.010645:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788909058.010689:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788909058.011824:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788909058.011854:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788909058.013483:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788909058.013497:0:6670:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788909058.013511:0:6670:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x733cfdd8721d53cf 00000020:01000004:2.0:1788909058.013520:0:6670:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788909058.013541:0:6670:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788909058.013545:0:6670:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788909058.013552:0:6670:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788909058.013556:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788909058.013586:0:6670:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89052d654d28) 00000020:00000080:2.0:1788909058.013600:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788909058.015896:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788909058.017211:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788909058.017221:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788909058.019418:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788909058.019433:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788909058.023052:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788909058.023066:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788909058.029673:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909058.030001:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788909058.030008:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788909058.031056:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788909058.031066:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788909058.056642:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909058.056980:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788909058.056988:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788909058.059466:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788909058.059483:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788909058.060498:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788909058.060509:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788909058.065040:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909058.065356:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788909058.065363:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788909058.066067:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788909058.066075:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788909058.121728:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788909058.121991:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788909058.121998:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788909058.123339:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788909058.123351:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788909058.124058:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788909058.124083:0:6670:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788909058.124089:0:6670:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788909058.153069:0:6670:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788909058.153364:0:6670:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788909058.153369:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788909058.153371:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788909058.153372:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909058.153374:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909058.153375:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909058.153377:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909058.153379:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909058.153380:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788909058.153382:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788909058.153383:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909058.153385:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788909058.153388:0:6670:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788909058.153390:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788909058.153391:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788909058.153393:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909058.153394:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909058.153395:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909058.153396:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909058.153397:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909058.153398:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788909058.153399:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788909058.153401:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909058.153402:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788909058.153428:0:6670:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788909058.153445:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019471616:0@lo:253: 00000100:00100000:2.0:1788909058.153514:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909058.153603:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085d1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788909058.153679:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019471616 00000100:00100000:1.0:1788909058.153689:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019471616 00000100:00100000:1.0:1788909058.153753:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788909058.153762:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019471616:12345-0@lo:253: 20000000:01000000:1.0:1788909058.153795:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788909058.153807:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788909058.153813:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788909058.153817:0:5816:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788909058.154731:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788909058.154958:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788909058.154973:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788909058.155015:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788909058.155022:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788909058.155056:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788909058.155105:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788909058.155573:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788909058.155597:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:1.0:1788909058.155600:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788909058.155636:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788909058.155645:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788909058.155694:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788909058.155703:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:1.0:1788909058.155737:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788909058.155746:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788909058.155786:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788909058.155833:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788909058.157791:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788909058.157830:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:1.0:1788909058.157834:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788909058.157970:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788909058.157980:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788909058.158013:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788909058.158020:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:1.0:1788909058.158067:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788909058.158077:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788909058.158375:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788909058.158416:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788909058.158452:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788909058.158455:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788909058.158459:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788909058.158475:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788909058.158478:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788909058.158662:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788909058.158665:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788909058.159804:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788909058.159913:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788909058.159976:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788909058.160527:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788909058.160576:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788909058.160638:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788909058.160652:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788909058.160655:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788909058.161510:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788909058.161854:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788909058.161910:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788909058.161992:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788909058.162008:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788909058.162011:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788909058.163027:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788909058.163348:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788909058.163413:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788909058.164016:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788909058.164062:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788909058.164096:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788909058.164348:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788909058.164352:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788909058.164363:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788909058.164394:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.164415:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890504d9d800/0x733cfdd8721d52f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d52ef expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.164424:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890504d9de00/0x733cfdd8721d5312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d530b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.164431:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501534600/0x733cfdd8721d5382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d537b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.164452:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.164634:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501534600/0x733cfdd8721d5382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d537b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.164650:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501534600/0x733cfdd8721d5382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d537b expref: 12 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909058.164665:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019471744:0@lo:104: 00000100:00100000:1.0:1788909058.164751:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788909058.164918:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890504d9de00/0x733cfdd8721d5312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d530b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.164926:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890504d9de00/0x733cfdd8721d5312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d530b expref: 12 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909058.164934:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019471872:0@lo:104: 00000100:00100000:1.0:1788909058.164963:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788909058.165896:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890504d9d800/0x733cfdd8721d52f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d52ef expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.165910:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890504d9d800/0x733cfdd8721d52f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d52ef expref: 12 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909058.165922:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019472000:0@lo:104: 00000100:00100000:1.0:1788909058.165991:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909058.166270:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019471744 00000100:00100000:3.0:1788909058.166285:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019471744 00000100:00100000:3.0:1788909058.166346:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019471872 00000100:00100000:3.0:1788909058.166350:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019471872 00000100:00100000:3.0:1788909058.166366:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788909058.166374:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+4:5816:x1875807019471744:12345-0@lo:104: 00010000:00010000:3.0:1788909058.166394:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89050bad9e00/0x733cfdd8721d537b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.166515:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788909058.166658:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+4:5816:x1875807019471744:12345-0@lo:104: Request processed in 283us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.166666:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788909058.166685:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909058.166691:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:5816:x1875807019471872:12345-0@lo:104: 00010000:00010000:3.0:1788909058.166709:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501534800/0x733cfdd8721d530b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909058.166843:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff89051ea46840 going to sleep for 11 seconds 00000100:00100000:1.0:1788909058.166875:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019471744:0@lo:104: 00000100:00100000:1.0:1788909058.166896:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019471872:0@lo:104: 00000100:00100000:0.0:1788909058.167026:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019472000 00000100:00100000:0.0:1788909058.167031:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019472000 00010000:00010000:2.0:1788909058.167232:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788909058.167243:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89050bad9e00/0x733cfdd8721d537b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.167251:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9e00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909058.167256:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9e00/0x733cfdd8721d537b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.167268:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89050bad9e00/0x733cfdd8721d537b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909058.167276:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9e00/0x733cfdd8721d537b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909058.167282:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909058.167415:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89050bad9e00/0x733cfdd8721d537b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.167422:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909058.167442:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89050bad9e00/0x733cfdd8721d537b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.167448:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89050bad9e00/0x733cfdd8721d537b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5382 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.167465:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909058.167469:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501534800/0x733cfdd8721d530b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.167475:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501534800 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909058.167491:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501534800/0x733cfdd8721d530b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.167498:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501534800/0x733cfdd8721d530b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909058.167505:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501534800/0x733cfdd8721d530b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909058.167516:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788909058.167677:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019472128:0@lo:103: 00000100:00100000:1.0:1788909058.167715:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.167772:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019472128 00000100:00100000:1.0:1788909058.167776:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019472128 00010000:00010000:1.0:1788909058.167796:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501534600/0x733cfdd8721d5382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d537b expref: 13 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909058.167819:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788909058.167827:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+13:3285:x1875807019472128:12345-0@lo:103: 00010000:00010000:1.0:1788909058.167837:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909058.167842:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501534600/0x733cfdd8721d5382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d537b expref: 13 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.167851:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501534600/0x733cfdd8721d5382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d537b expref: 13 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.167884:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501534600/0x733cfdd8721d5382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d537b expref: 13 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.167909:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909058.167950:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+12:3285:x1875807019472128:12345-0@lo:103: Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909058.167957:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788909058.167995:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019472128:0@lo:103: 00010000:00010000:3.0:1788909058.168243:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788909058.168251:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+4:5816:x1875807019471872:12345-0@lo:104: Request processed in 1560us (3286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.168264:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909058.168280:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788909058.168294:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:5816:x1875807019472000:12345-0@lo:104: 00010000:00010000:3.0:1788909058.168304:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d52ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.168356:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788909058.168370:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:5816:x1875807019472000:12345-0@lo:104: Request processed in 76us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.168376:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788909058.168468:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788909058.168794:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019472000:0@lo:104: 00010000:00010000:1.0:1788909058.168820:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.169085:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501534800/0x733cfdd8721d530b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.169100:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788909058.169344:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019472256:0@lo:103: 00000100:00100000:1.0:1788909058.169390:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788909058.169449:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501534800/0x733cfdd8721d530b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.169458:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501534800/0x733cfdd8721d530b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5312 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.169473:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909058.169475:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909058.169477:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909058.169541:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019472256 00000100:00100000:0.0:1788909058.169548:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019472256 00010000:00010000:0.0:1788909058.169569:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890504d9de00/0x733cfdd8721d5312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d530b expref: 12 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909058.169603:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788909058.169611:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+12:3286:x1875807019472256:12345-0@lo:103: 00010000:00010000:0.0:1788909058.169621:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909058.169636:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890504d9de00/0x733cfdd8721d5312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d530b expref: 12 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.169646:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890504d9de00/0x733cfdd8721d5312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d530b expref: 12 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.169664:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9de00/0x733cfdd8721d5312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d530b expref: 12 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.169675:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909058.170002:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909058.170005:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909058.170007:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909058.170045:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d52ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.170054:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535400 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909058.170066:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d52ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.170074:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d52ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909058.170098:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d52ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909058.170138:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909058.170171:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d52ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.170178:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909058.170199:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d52ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.170206:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d52ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d52f6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.170228:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909058.170230:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909058.170232:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909058.170471:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+11:3286:x1875807019472256:12345-0@lo:103: Request processed in 859us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909058.170480:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788909058.170531:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019472384:0@lo:103: 00000100:00100000:0.0:1788909058.170571:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909058.170780:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019472384 00000100:00100000:3.0:1788909058.170785:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019472384 00010000:00010000:3.0:1788909058.170809:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890504d9d800/0x733cfdd8721d52f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d52ef expref: 11 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909058.170842:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788909058.170850:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de4f34ee-762f-480d-9428-329e99488659+11:3283:x1875807019472384:12345-0@lo:103: 00010000:00010000:3.0:1788909058.170888:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909058.170893:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890504d9d800/0x733cfdd8721d52f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d52ef expref: 11 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.170917:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890504d9d800/0x733cfdd8721d52f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d52ef expref: 11 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.170929:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9d800/0x733cfdd8721d52f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d52ef expref: 11 pid: 5816 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.170943:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.170960:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.170975:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.170982:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.170989:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.170996:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.171001:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692a00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909058.171006:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.171013:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.171040:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.171059:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909058.171100:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de4f34ee-762f-480d-9428-329e99488659+10:3283:x1875807019472384:12345-0@lo:103: Request processed in 251us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.171151:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788909058.171302:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019472256:0@lo:103: 00010000:00010000:1.0:1788909058.171350:0:5816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.171359:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.171367:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501692a00/0x733cfdd8721d53dd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909058.171370:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019472384:0@lo:103: 20000000:01000000:1.0:1788909058.171389:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788909058.251619:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+9:6670:x1875807019471616:12345-0@lo:253: Request processed in 97843us (98089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909058.251638:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788909058.251779:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019471616:0@lo:253: 10000000:01000000:2.0:1788909058.251797:0:6670:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788909058.251800:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788909058.251802:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788909058.251803:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909058.251805:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788909058.251806:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909058.251807:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909058.251809:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909058.251811:0:6670:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788909058.251813:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909058.251814:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788909058.251844:0:6670:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8905068d9800 from lustre-OST0000 10000000:01000000:2.0:1788909058.251885:0:6670:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788909058.251892:0:6670:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788909058.251899:0:6670:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890508884d28 local copy 10000000:01000000:2.0:1788909058.251903:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788909058.251936:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.251947:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.251957:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909058.251978:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019472512:0@lo:101: 00000100:00100000:2.0:1788909058.252028:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909058.252083:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788909058.252225:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019472512 00000100:00100000:0.0:1788909058.252232:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019472512 00000100:00100000:0.0:1788909058.252276:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788909058.252285:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+9:6670:x1875807019472512:12345-0@lo:101: 00010000:00010000:0.0:1788909058.252297:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909058.252311:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9de00/0x733cfdd8721d53eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d53e4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.252356:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9de00/0x733cfdd8721d53eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d53e4 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.252368:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9de00/0x733cfdd8721d53eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d53e4 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.252380:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9de00, rc 0) 00000100:00100000:0.0:1788909058.252412:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+10:6670:x1875807019472512:12345-0@lo:101: Request processed in 128us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909058.252418:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788909058.252578:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019472512:0@lo:101: 00010000:00010000:2.0:1788909058.252591:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.252600:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909058.252727:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019472640:0@lo:501: 00000100:00100000:2.0:1788909058.252755:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909058.252786:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788909058.252842:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019472640 00000100:00100000:0.0:1788909058.252846:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019472640 00000100:00100000:0.0:1788909058.252879:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788909058.252886:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+10:6670:x1875807019472640:12345-0@lo:501: 00000100:00100000:0.0:1788909058.253189:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+10:6670:x1875807019472640:12345-0@lo:501: Request processed in 302us (431us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788909058.253197:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788909058.253237:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019472640:0@lo:501: 10000000:01000000:0.0:1788909058.253250:0:6670:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788909058.253277:0:6670:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788909058.253289:0:6670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.253297:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.253303:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.253315:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788909058.253349:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8905068d9800 10000000:01000000:0.0:1788909058.253354:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788909058.253358:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff890508884d28 10000000:01000000:0.0:1788909058.253361:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788909058.253364:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff890508884d28 from 1 10000000:01000000:0.0:1788909058.253367:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788909058.253384:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.253391:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.253398:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909058.253409:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019472768:0@lo:101: 00000100:00100000:0.0:1788909058.253434:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909058.253451:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e90840 going to sleep for 11 seconds 00010000:00010000:2.0:1788909058.253644:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909058.253652:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.253660:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535400 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909058.253672:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.253681:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909058.253689:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909058.253695:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909058.253715:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.253722:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909058.253747:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.253755:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d53e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x733cfdd8721d53eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.253772:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909058.253774:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909058.253775:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909058.253787:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019472768 00000100:00100000:2.0:1788909058.253791:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019472768 00000100:00100000:2.0:1788909058.253817:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788909058.253825:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+10:6670:x1875807019472768:12345-0@lo:101: 00010000:00010000:2.0:1788909058.253833:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909058.253844:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501534800/0x733cfdd8721d53f9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d53f2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.253873:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501534800/0x733cfdd8721d53f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d53f2 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.253881:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501534800/0x733cfdd8721d53f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d53f2 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.253890:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501534800, rc 0) 00000100:00100000:2.0:1788909058.253917:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019472768:12345-0@lo:101: Request processed in 93us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909058.253923:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788909058.254352:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019472896:0@lo:103: 00000100:00100000:0.0:1788909058.254383:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909058.254452:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019472768:0@lo:101: 00010000:00010000:0.0:1788909058.254465:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d53f9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.254474:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d53f9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909058.254492:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788909058.254508:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d53f9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.254517:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d53f9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909058.254524:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788909058.254528:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788909058.254533:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788909058.254535:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788909058.254550:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.254557:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.254564:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909058.254576:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473024:0@lo:101: 00000100:00100000:0.0:1788909058.254601:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909058.254613:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e90840 going to sleep for 11 seconds 00000100:00100000:2.0:1788909058.254686:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019472896 00000100:00100000:2.0:1788909058.254690:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019472896 00000100:00100000:2.0:1788909058.254731:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909058.254739:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+11:3284:x1875807019472896:12345-0@lo:103: 00010000:00010000:2.0:1788909058.254748:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909058.254762:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9de00/0x733cfdd8721d53eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d53e4 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.254775:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909058.254805:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+10:3284:x1875807019472896:12345-0@lo:103: Request processed in 67us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909058.254811:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909058.254829:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019473024 00000100:00100000:2.0:1788909058.254832:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019473024 00000100:00100000:2.0:1788909058.254852:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788909058.254857:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+10:6670:x1875807019473024:12345-0@lo:101: 00010000:00010000:2.0:1788909058.254863:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909058.254876:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5400 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.254888:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5400 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.254896:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5400 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.254902:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501534600, rc 0) 00000100:00100000:2.0:1788909058.254925:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473024:12345-0@lo:101: Request processed in 68us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909058.254930:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788909058.255269:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019472896:0@lo:103: 00000100:00100000:0.0:1788909058.255298:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473024:0@lo:101: 00010000:00010000:0.0:1788909058.255308:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.255315:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909058.255408:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473152:0@lo:501: 00000100:00100000:0.0:1788909058.255433:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909058.255500:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e90840 going to sleep for 11 seconds 00000100:00100000:2.0:1788909058.255596:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019473152 00000100:00100000:2.0:1788909058.255601:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019473152 00000100:00100000:2.0:1788909058.255673:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788909058.255680:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473152:12345-0@lo:501: 00000100:00100000:2.0:1788909058.255915:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473152:12345-0@lo:501: Request processed in 234us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909058.255922:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788909058.255992:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473152:0@lo:501: 00000100:00100000:1.0:1788909058.256035:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473280:0@lo:503: 00000100:00100000:1.0:1788909058.256074:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.256434:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890513423840 going to sleep for 11 seconds 00000100:00100000:0.0:1788909058.256510:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019473280 00000100:00100000:0.0:1788909058.256515:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019473280 00000100:00100000:0.0:1788909058.256540:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788909058.256546:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473280:12345-0@lo:503: 00000100:00100000:0.0:1788909058.256719:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473280:12345-0@lo:503: Request processed in 172us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909058.256726:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788909058.256816:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473280:0@lo:503: 00000040:00080000:1.0:1788909058.257265:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788909058.257351:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473408:0@lo:502: 00000100:00100000:1.0:1788909058.257394:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.257421:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890513423840 going to sleep for 11 seconds 00000100:00100000:0.0:1788909058.257492:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019473408 00000100:00100000:0.0:1788909058.257497:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019473408 00000100:00100000:0.0:1788909058.257519:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788909058.257525:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473408:12345-0@lo:502: 00000100:00100000:0.0:1788909058.257722:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473408:12345-0@lo:502: Request processed in 196us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909058.257729:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788909058.258004:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473408:0@lo:502: 00000040:00080000:1.0:1788909058.258531:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788909058.258588:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788909058.258637:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788909058.258685:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788909058.258724:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788909058.258756:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788909058.258791:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473536:0@lo:502: 00000100:00100000:1.0:1788909058.258840:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.258925:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890513423840 going to sleep for 11 seconds 00000100:00100000:0.0:1788909058.258985:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019473536 00000100:00100000:0.0:1788909058.258992:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019473536 00000100:00100000:1.0:1788909058.259385:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788909058.259395:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473536:12345-0@lo:502: 00000100:00100000:1.0:1788909058.259587:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473536:12345-0@lo:502: Request processed in 194us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909058.259595:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788909058.259683:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473536:0@lo:502: 00000040:00080000:0.0:1788909058.259796:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788909058.259809:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788909058.260473:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788909058.260481:0:6692:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788909058.260488:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909058.260490:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788909058.260495:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788909058.260509:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89053cc54d28) 00000020:00000080:3.0:1788909058.260530:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788909058.260536:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788909058.260610:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8905068d9800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788909058.260617:0:6692:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788909058.260624:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x733cfdd8721d5415 00010000:00010000:3.0:1788909058.267549:0:6692:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788909058.267914:0:6692:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788909058.270820:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788909058.271255:0:6692:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788909058.300861:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788909058.301694:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788909058.308668:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788909058.308686:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909058.308696:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909058.308698:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788909058.308702:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909058.308706:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909058.308707:0:6692:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788909058.308710:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788909058.308723:0:6692:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788909058.308905:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909058.308908:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909058.308910:0:6692:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788909058.308914:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788909058.316251:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788909058.316300:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788909058.316334:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.316349:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909058.316360:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905068d9800 from 1 10000000:01000000:0.0:1788909058.316363:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788909058.316416:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.316424:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.316436:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909058.316465:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473664:0@lo:101: 00000100:00100000:0.0:1788909058.316549:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909058.316602:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909058.318284:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019473664 00000100:00100000:3.0:1788909058.318299:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019473664 00000100:00100000:3.0:1788909058.318381:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788909058.318392:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+11:6670:x1875807019473664:12345-0@lo:101: 00010000:00010000:3.0:1788909058.318413:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909058.318433:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d541c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.318467:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d541c expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.318478:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d541c expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.318490:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad8200, rc 0) 00000100:00100000:3.0:1788909058.318578:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019473664:12345-0@lo:101: Request processed in 187us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.318585:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788909058.319234:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473664:0@lo:101: 00010000:00010000:0.0:1788909058.319257:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909058.319268:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909058.319451:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473792:0@lo:501: 00000100:00100000:0.0:1788909058.319495:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909058.319537:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909058.320275:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019473792 00000100:00100000:3.0:1788909058.320284:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019473792 00000100:00100000:3.0:1788909058.320340:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788909058.320351:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019473792:12345-0@lo:501: 00000100:00100000:3.0:1788909058.320642:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019473792:12345-0@lo:501: Request processed in 292us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.320650:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788909058.321873:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473792:0@lo:501: 00000100:00100000:0.0:1788909058.321938:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473920:0@lo:503: 00000100:00100000:0.0:1788909058.322009:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.323194:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019473920 00000100:00100000:1.0:1788909058.323207:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019473920 00000100:00100000:0.0:1788909058.323233:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a58f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788909058.323274:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788909058.323284:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019473920:12345-0@lo:503: 00000100:00100000:1.0:1788909058.324221:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019473920:12345-0@lo:503: Request processed in 932us (2205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909058.324233:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788909058.324311:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019473920:0@lo:503: 00000040:00080000:1.0:1788909058.326956:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788909058.327447:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474048:0@lo:502: 00000100:00100000:1.0:1788909058.327560:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.327620:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890513423000 going to sleep for 11 seconds 00000100:00100000:3.0:1788909058.327806:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019474048 00000100:00100000:3.0:1788909058.327817:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019474048 00000100:00100000:3.0:1788909058.327882:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788909058.327892:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019474048:12345-0@lo:502: 00000100:00100000:3.0:1788909058.329195:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019474048:12345-0@lo:502: Request processed in 1295us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.329208:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788909058.331348:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474048:0@lo:502: 00000040:00080000:0.0:1788909058.331786:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788909058.331856:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788909058.331901:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474176:0@lo:502: 00000100:00100000:0.0:1788909058.331978:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909058.332038:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a58f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788909058.332553:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019474176 00000100:00100000:1.0:1788909058.332566:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019474176 00000100:00100000:1.0:1788909058.332628:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788909058.332638:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019474176:12345-0@lo:502: 00000100:00100000:1.0:1788909058.332890:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019474176:12345-0@lo:502: Request processed in 252us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909058.332906:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788909058.334364:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474176:0@lo:502: 00000040:00080000:0.0:1788909058.334589:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788909058.334606:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788909058.339798:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909058.339817:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909058.339820:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788909058.339830:0:6696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8905068d9800 00000020:00000080:0.0:1788909058.339832:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788909058.339855:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909058.339859:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909058.339860:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788909058.339879:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788909058.340256:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788909058.340287:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788909058.340306:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.340331:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909058.340376:0:6670:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788909058.340379:0:6670:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8905068d9800 10000000:01000000:1.0:1788909058.340382:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8905068d9800 10000000:01000000:1.0:1788909058.340387:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788909058.340393:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905068d9800 from 1 10000000:01000000:1.0:1788909058.340397:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788909058.340447:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.340457:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.340471:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909058.340502:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474304:0@lo:101: 00000100:00100000:1.0:1788909058.340590:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.340646:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508875240 going to sleep for 11 seconds 00000100:00100000:2.0:1788909058.340717:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019474304 00000100:00100000:2.0:1788909058.340736:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019474304 00000100:00100000:2.0:1788909058.340782:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788909058.340793:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019474304:12345-0@lo:101: 00010000:00010000:2.0:1788909058.340806:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909058.340820:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d542a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.340859:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d542a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.340871:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d542a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.340881:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501535400, rc 0) 00000100:00100000:2.0:1788909058.340918:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019474304:12345-0@lo:101: Request processed in 126us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909058.340925:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788909058.342645:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474304:0@lo:101: 00010000:00010000:1.0:1788909058.342678:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.343335:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909058.343501:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474432:0@lo:501: 00000100:00100000:1.0:1788909058.343577:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.343658:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508875240 going to sleep for 11 seconds 00000100:00100000:0.0:1788909058.344550:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019474432 00000100:00100000:0.0:1788909058.344565:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019474432 00000100:00100000:1.0:1788909058.344676:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788909058.344699:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019474432:12345-0@lo:501: 00000100:00100000:1.0:1788909058.345067:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019474432:12345-0@lo:501: Request processed in 382us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909058.345076:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788909058.345516:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474432:0@lo:501: 00000100:00100000:0.0:1788909058.345598:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474560:0@lo:503: 00000100:00100000:0.0:1788909058.345657:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909058.345706:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a58180 going to sleep for 11 seconds 00000100:00100000:2.0:1788909058.345839:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019474560 00000100:00100000:2.0:1788909058.345845:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019474560 00000100:00100000:2.0:1788909058.345888:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788909058.345897:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019474560:12345-0@lo:503: 00000100:00100000:2.0:1788909058.346077:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019474560:12345-0@lo:503: Request processed in 180us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909058.346084:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788909058.346483:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474560:0@lo:503: 00000040:00080000:1.0:1788909058.347523:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788909058.347631:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474688:0@lo:502: 00000100:00100000:1.0:1788909058.347693:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.347738:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508875e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788909058.347864:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019474688 00000100:00100000:2.0:1788909058.347870:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019474688 00000100:00100000:2.0:1788909058.347913:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788909058.347922:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019474688:12345-0@lo:502: 00000100:00100000:2.0:1788909058.348537:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019474688:12345-0@lo:502: Request processed in 614us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909058.348547:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788909058.350936:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474688:0@lo:502: 00000040:00080000:1.0:1788909058.351590:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788909058.351673:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788909058.351855:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788909058.351908:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788909058.351947:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788909058.352007:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788909058.352330:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788909058.352367:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788909058.352416:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788909058.352451:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788909058.352479:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788909058.352554:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788909058.352593:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788909058.352628:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788909058.352704:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788909058.352918:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788909058.352954:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788909058.353001:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788909058.353597:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788909058.353642:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788909058.354953:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788909058.355089:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788909058.355187:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788909058.355253:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788909058.355586:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788909058.355625:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788909058.355676:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788909058.355714:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788909058.355847:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474816:0@lo:502: 00000100:00100000:1.0:1788909058.355983:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909058.356057:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508875e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909058.356077:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019474816 00000100:00100000:3.0:1788909058.356087:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019474816 00000100:00100000:3.0:1788909058.356192:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788909058.356204:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019474816:12345-0@lo:502: 00000100:00100000:3.0:1788909058.356621:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019474816:12345-0@lo:502: Request processed in 417us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.356631:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788909058.357006:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019474816:0@lo:502: 00000040:00080000:1.0:1788909058.357267:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788909058.357280:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788909058.365438:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788909058.365459:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89052e9019b8) 00000020:00000080:1.0:1788909058.365486:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788909058.365572:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8905068d9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788909058.365576:0:6697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8905068d9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788909058.365579:0:6697:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905068d9800 3 00010000:00080000:1.0:1788909058.365611:0:6697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890537882800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788909058.371587:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788909058.372550:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788909058.372594:0:6697:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788909058.372609:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x733cfdd8721d543f 00000100:00080000:1.0:1788909058.372621:0:6697:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788909058.372627:0:6697:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff890537882800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788909058.372661:0:6697:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89051175c700 x1875807019474944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788909058.372705:0:6697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788909058.372962:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788909058.372976:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019475072:0@lo:400: 00000100:00100000:0.0:1788909058.373067:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909058.373434:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019475072 00000100:00100000:0.0:1788909058.373442:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019475072 00000100:00100000:0.0:1788909058.373481:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788909058.373489:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019475072:12345-0@lo:400: 00000100:00100000:0.0:1788909058.373544:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019475072:12345-0@lo:400: Request processed in 55us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909058.373551:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788909058.373596:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890510387b80 x1875807019475072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909058.373609:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019475072:0@lo:400: 00000100:00100000:3.0:1788909058.373697:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875807019474944:0@lo:38: 00000100:00100000:3.0:1788909058.373846:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788909058.374311:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1788909058.374511:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019474944 00000100:00100000:0.0:1788909058.374517:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019474944 00000100:00100000:0.0:1788909058.374548:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788909058.374555:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1875807019474944:12345-0@lo:38: 00010000:00080000:0.0:1788909058.374583:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:0.0:1788909058.374628:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x733cfdd8721d5446 00000004:00100000:0.0:1788909058.374646:0:5823:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788909058.374681:0:5823:0:(import.c:65:import_set_state_nolock()) ffff890534067800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788909058.375611:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875807019474944:12345-0@lo:38: Request processed in 1051us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909058.375622:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788909058.375865:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89051175c700 x1875807019474944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788909068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909058.375877:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788909058.375886:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788909058.375894:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788909058.375899:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788909058.375901:0:3282:0:(import.c:65:import_set_state_nolock()) ffff890537882800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788909058.375908:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875807019474944:0@lo:38: 00000020:01000000:3.0:1788909058.376227:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788909058.376278:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788909058.376299:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.376309:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788909058.376368:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788909058.376371:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788909058.376373:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788909058.376374:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788909058.376375:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788909058.376376:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788909058.376378:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788909058.376379:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788909058.376381:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788909058.376383:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788909058.376384:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788909058.376389:0:6670:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788909058.376392:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788909058.376394:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788909058.376395:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788909058.376396:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788909058.376397:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788909058.376399:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788909058.376399:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788909058.376400:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788909058.376401:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788909058.376403:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788909058.376404:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788909058.376427:0:6670:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788909058.376445:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019475200:0@lo:253: 00000100:00100000:3.0:1788909058.376500:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909058.376836:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff890533d256c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909058.385043:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019475200 00000100:00100000:1.0:1788909058.385059:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019475200 00000100:00100000:1.0:1788909058.385278:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788909058.385288:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:6670:x1875807019475200:12345-0@lo:253: 20000000:01000000:1.0:1788909058.385335:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788909058.385354:0:5817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788909058.435142:0:5817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788909058.435166:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788909058.435519:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788909058.435524:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788909058.435551:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.435594:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501693600/0x733cfdd8721d53ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d53a5 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.435605:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.435649:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501693600/0x733cfdd8721d53ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d53a5 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.435664:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501693600/0x733cfdd8721d53ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d53a5 expref: 13 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909058.435682:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875807019475328:0@lo:104: 00000100:00100000:2.0:1788909058.435835:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909058.435945:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506794780 going to sleep for 11 seconds 00000100:00100000:2.0:1788909058.436592:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019475328 00000100:00100000:2.0:1788909058.436603:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019475328 00000100:00100000:2.0:1788909058.436674:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788909058.436696:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+3:5838:x1875807019475328:12345-0@lo:104: 00010000:00010000:2.0:1788909058.436714:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d53a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909058.436796:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788909058.436802:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+3:5838:x1875807019475328:12345-0@lo:104: Request processed in 119us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909058.436810:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788909058.437029:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875807019475328:0@lo:104: 00010000:00010000:1.0:1788909058.437052:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437252:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909058.437260:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d53a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437280:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535c00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:3.0:1788909058.437285:0:6689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d53a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437294:0:6689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d53a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788909058.437302:0:6689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d53a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909058.437309:0:6689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788909058.437362:0:6689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d53a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437369:0:6689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788909058.437391:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d53a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437398:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d53a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d53ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437415:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909058.437417:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909058.437419:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909058.437443:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019475456:0@lo:103: 00000100:00100000:3.0:1788909058.437484:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909058.437543:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019475456 00000100:00100000:3.0:1788909058.437547:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019475456 00010000:00010000:3.0:1788909058.437566:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501693600/0x733cfdd8721d53ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d53a5 expref: 14 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909058.437595:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788909058.437602:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905103e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+14:3286:x1875807019475456:12345-0@lo:103: 00010000:00010000:3.0:1788909058.437613:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909058.437618:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501693600/0x733cfdd8721d53ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d53a5 expref: 14 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437628:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501693600/0x733cfdd8721d53ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d53a5 expref: 14 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437641:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501693600/0x733cfdd8721d53ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d53a5 expref: 14 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437655:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437663:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788909058.437676:0:5809:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002152529s 00010000:00010000:3.0:1788909058.437680:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437880:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437888:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437895:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437906:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501534c00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909058.437910:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.437918:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.439718:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909058.439746:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.440000:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.440019:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501534c00/0x733cfdd8721d544d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909058.440046:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909058.440176:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905103e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+13:3286:x1875807019475456:12345-0@lo:103: Request processed in 2570us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.440189:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788909058.440490:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019475456:0@lo:103: 00000100:00100000:3.0:1788909058.447021:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:6670:x1875807019475200:12345-0@lo:253: Request processed in 61715us (70501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909058.447036:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788909058.447291:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:6670:1875807019475200:0@lo:253: 10000000:01000000:2.0:1788909058.447329:0:6670:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788909058.447333:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788909058.447334:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788909058.447336:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909058.447337:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909058.447338:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909058.447339:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909058.447341:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909058.447343:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788909058.447344:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788909058.447346:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909058.447347:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788909058.447362:0:6670:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788909058.452719:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909058.452973:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909058.453697:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909058.453970:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909058.454424:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909058.454680:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788909058.459389:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788909058.721600:0:6670:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788909058.721611:0:6670:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788909058.721652:0:6670:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788909058.721717:0:6670:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788909058.721755:0:6670:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788909058.721789:0:6670:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788909058.757463:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909059.786682:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909060.808551:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909061.833404:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909062.853986:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909063.816452:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019475584:0@lo:400: 00000100:00100000:0.0:1788909063.816540:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909063.816612:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788909063.816619:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019475712:0@lo:400: 00000100:00100000:0.0:1788909063.816649:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909063.816684:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019475840:0@lo:400: 00000100:00100000:0.0:1788909063.816713:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909063.816750:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019475584 00000100:00100000:0.0:1788909063.816759:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019475584 00000100:00100000:0.0:1788909063.816806:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788909063.816816:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:3283:x1875807019475584:12345-0@lo:400: 00000100:00100000:0.0:1788909063.816871:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:3283:x1875807019475584:12345-0@lo:400: Request processed in 55us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909063.816878:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788909063.816921:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019475712 00000100:00100000:0.0:1788909063.816925:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019475712 00000100:00100000:0.0:1788909063.816949:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019475840 00000100:00100000:0.0:1788909063.816951:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019475840 00000100:00100000:0.0:1788909063.816993:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788909063.816999:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019475712:12345-0@lo:400: 00000100:00100000:0.0:1788909063.817031:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019475712:12345-0@lo:400: Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909063.817036:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788909063.817047:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788909063.817052:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019475840:12345-0@lo:400: 00000100:00100000:0.0:1788909063.817077:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019475840:12345-0@lo:400: Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909063.817083:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788909063.817151:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890510386a00 x1875807019475840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909063.817168:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019475840:0@lo:400: 00010000:00080000:0.0:1788909063.817195:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890510384700 x1875807019475712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909063.817205:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019475712:0@lo:400: 00000100:00100000:0.0:1788909063.817213:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019475584:0@lo:400: 00000100:00080000:2.0:1788909063.819047:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788909063.880351:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909064.901374:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788909065.572402:0:7042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788909065.925569:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909066.949381:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788909067.910658:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788909067.910665:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905103af000 from 21 10000000:01000000:0.0:1788909067.910671:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788909067.910728:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909067.910740:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909067.910769:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909067.910796:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019475968:0@lo:101: 00000100:00100000:0.0:1788909067.911066:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909067.911185:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905117f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788909067.913161:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019475968 00000100:00100000:1.0:1788909067.913180:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019475968 00000100:00100000:1.0:1788909067.913269:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788909067.913281:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019475968:12345-0@lo:101: 00010000:00010000:1.0:1788909067.913303:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909067.913330:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5454 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909067.913367:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5454 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909067.913381:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5454 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909067.913393:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692600, rc 0) 00000100:00100000:1.0:1788909067.913494:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019475968:12345-0@lo:101: Request processed in 216us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909067.913501:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788909067.913755:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019475968:0@lo:101: 00010000:00010000:2.0:1788909067.913776:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909067.913787:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909067.913863:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476096:0@lo:501: 00000100:00100000:2.0:1788909067.913901:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909067.914418:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537986300 going to sleep for 11 seconds 00000100:00100000:1.0:1788909067.918314:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019476096 00000100:00100000:1.0:1788909067.918332:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019476096 00000100:00100000:1.0:1788909067.918837:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788909067.918850:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019476096:12345-0@lo:501: 00000100:00100000:1.0:1788909067.919481:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019476096:12345-0@lo:501: Request processed in 633us (5577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909067.919491:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788909067.920183:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476096:0@lo:501: 00000100:00100000:2.0:1788909067.920255:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476224:0@lo:503: 00000100:00100000:2.0:1788909067.920324:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909067.920368:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537986300 going to sleep for 11 seconds 00000100:00100000:0.0:1788909067.920470:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019476224 00000100:00100000:0.0:1788909067.920477:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019476224 00000100:00100000:0.0:1788909067.920522:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788909067.920532:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019476224:12345-0@lo:503: 00000100:00100000:0.0:1788909067.921216:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019476224:12345-0@lo:503: Request processed in 683us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909067.921225:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788909067.924085:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476224:0@lo:503: 00000100:00100000:2.0:1788909067.925191:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:7147:1875807019476352:0@lo:502: 00000100:00100000:2.0:1788909067.925324:0:7147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909067.925381:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537986a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788909067.925633:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019476352 00000100:00100000:0.0:1788909067.925642:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019476352 00000100:00100000:0.0:1788909067.925799:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788909067.925811:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7147:x1875807019476352:12345-0@lo:502: 00000100:00100000:0.0:1788909067.926298:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7147:x1875807019476352:12345-0@lo:502: Request processed in 488us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909067.926308:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788909067.926728:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:7147:1875807019476352:0@lo:502: 00000100:00100000:3.0:1788909067.926805:0:7147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:7147:1875807019476480:0@lo:502: 00000100:00100000:3.0:1788909067.926845:0:7147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909067.933445:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019476480 00000100:00100000:1.0:1788909067.933469:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019476480 00000100:00100000:1.0:1788909067.933525:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788909067.933550:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:7147:x1875807019476480:12345-0@lo:502: 00000100:00100000:1.0:1788909067.934237:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:7147:x1875807019476480:12345-0@lo:502: Request processed in 686us (7387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909067.934247:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788909067.937893:0:7147:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508875840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909067.937953:0:7147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:7147:1875807019476480:0@lo:502: 00000040:00080000:3.0:1788909067.938003:0:7147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788909067.939496:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788909067.939531:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788909067.939544:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909067.939557:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909067.939586:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788909067.939589:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8905103af000 from 4 10000000:01000000:0.0:1788909067.939592:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788909067.939702:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909067.939711:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909067.939723:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909067.939749:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476608:0@lo:101: 00000100:00100000:0.0:1788909067.939818:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909067.939864:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905117f9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909067.940384:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019476608 00000100:00100000:2.0:1788909067.940408:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019476608 00000100:00100000:2.0:1788909067.940478:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788909067.940488:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019476608:12345-0@lo:101: 00010000:00010000:2.0:1788909067.940503:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909067.940519:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5462 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909067.940547:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5462 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909067.940558:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5462 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909067.940568:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501534000, rc 0) 00000100:00100000:2.0:1788909067.940634:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019476608:12345-0@lo:101: Request processed in 147us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909067.940641:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788909067.941165:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476608:0@lo:101: 00010000:00010000:0.0:1788909067.941187:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909067.941208:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909067.941279:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476736:0@lo:256: 00000100:00100000:0.0:1788909067.941321:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909067.941352:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905117f9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909067.941532:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019476736 00000100:00100000:1.0:1788909067.941538:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019476736 00000100:00100000:1.0:1788909067.941584:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788909067.941594:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019476736:12345-0@lo:256: 20000000:01000000:1.0:1788909067.941612:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788909067.941632:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788909067.941635:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788909067.941735:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019476736:12345-0@lo:256: Request processed in 142us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909067.941744:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788909067.942085:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476736:0@lo:256: 10000000:01000000:0.0:1788909067.942192:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788909067.942278:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909067.942287:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909067.942298:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788909067.942300:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788909067.942303:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788909067.942329:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909067.942337:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909067.942346:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909067.942361:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476864:0@lo:101: 00000100:00100000:0.0:1788909067.942520:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909067.942595:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905117f9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909067.949077:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019476864 00000100:00100000:1.0:1788909067.949097:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019476864 00000100:00100000:1.0:1788909067.950607:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788909067.950640:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019476864:12345-0@lo:101: 00010000:00010000:1.0:1788909067.950668:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909067.950710:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5470 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909067.950752:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5470 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909067.950766:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5470 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909067.950776:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693a00, rc 0) 00000100:00100000:2.0:1788909067.951275:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476864:0@lo:101: 00010000:00010000:2.0:1788909067.951297:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909067.951309:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909067.951416:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476992:0@lo:501: 00000100:00100000:2.0:1788909067.951464:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909067.951518:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019476864:12345-0@lo:101: Request processed in 894us (8998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909067.951526:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788909067.953579:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909067.953761:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019476992 00000100:00100000:1.0:1788909067.953772:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019476992 00000100:00100000:1.0:1788909067.953833:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788909067.953843:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019476992:12345-0@lo:501: 00000100:00100000:1.0:1788909067.954577:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019476992:12345-0@lo:501: Request processed in 731us (3108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909067.954587:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788909067.955461:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019476992:0@lo:501: 00000100:00100000:2.0:1788909067.955524:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019477120:0@lo:503: 00000100:00100000:2.0:1788909067.955593:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909067.955650:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909067.955969:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019477120 00000100:00100000:1.0:1788909067.955977:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019477120 00000100:00100000:1.0:1788909067.956027:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788909067.956036:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019477120:12345-0@lo:503: 00000100:00100000:1.0:1788909067.956495:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019477120:12345-0@lo:503: Request processed in 458us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909067.956502:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788909067.956986:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019477120:0@lo:503: 00000100:00100000:2.0:1788909067.957763:0:7148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:7148:1875807019477248:0@lo:502: 00000100:00100000:2.0:1788909067.957845:0:7148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909067.957882:0:7148:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537986d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788909067.958666:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019477248 00000100:00100000:1.0:1788909067.958686:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019477248 00000100:00100000:1.0:1788909067.958738:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788909067.958748:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:7148:x1875807019477248:12345-0@lo:502: 00000100:00100000:1.0:1788909067.959648:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:7148:x1875807019477248:12345-0@lo:502: Request processed in 896us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909067.959658:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788909067.960192:0:7148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:7148:1875807019477248:0@lo:502: 00000020:01000000:2.0:1788909067.960240:0:7148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788909067.960249:0:7148:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788909067.960258:0:7148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909067.960260:0:7148:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788909067.960267:0:7148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788909067.960271:0:7148:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:2.0:1788909067.960295:0:7148:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788909067.960308:0:7148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788909067.960324:0:7148:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89052d650000) 00000020:00000080:2.0:1788909067.960346:0:7148:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788909067.960353:0:7148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788909067.960611:0:7148:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788909067.960631:0:7148:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788909067.960639:0:7148:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d5485 00010000:00080000:2.0:1788909067.960674:0:7148:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89052d670000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788909067.961350:0:7148:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:0.0:1788909067.975080:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788909068.036985:0:7148:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788909068.037011:0:7148:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788909068.038748:0:7148:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788909068.039026:0:7148:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788909068.039086:0:7148:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788909068.040061:0:7148:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788909068.044198:0:7151:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788909068.044213:0:7151:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788909068.045810:0:7148:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788909068.045826:0:7148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788909068.045940:0:7148:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788909068.045967:0:7148:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d548c 00000100:00080000:3.0:1788909068.045980:0:7148:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788909068.045988:0:7148:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89052d670000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788909068.046034:0:7148:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8905064d7800 x1875807019477376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788909068.046106:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019477376:0@lo:8: 00000100:00100000:2.0:1788909068.046448:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909068.046681:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019477376 00000100:00100000:0.0:1788909068.046689:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019477376 00000100:00100000:0.0:1788909068.046736:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788909068.046744:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875807019477376:12345-0@lo:8: 00010000:00080000:0.0:1788909068.046772:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:0.0:1788909068.046806:0:6673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d5493 00002000:00100000:0.0:1788909068.046855:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89053460e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113956 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788909068.046876:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788909068.046881:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788909068.047010:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788909068.047192:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788909068.047230:0:6673:0:(import.c:65:import_set_state_nolock()) ffff89053460d800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788909068.047608:0:7148:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788909068.047685:0:7148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909068.047692:0:7148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909068.047694:0:7148:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788909068.047697:0:7148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909068.047701:0:7148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909068.047702:0:7148:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788909068.047704:0:7148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788909068.047706:0:7148:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788909068.047735:0:7148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:7148:1875807019477504:0@lo:502: 00000100:00100000:3.0:1788909068.047787:0:7148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909068.047814:0:7148:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508875000 going to sleep for 11 seconds 00000100:00100000:3.0:1788909068.047893:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019477632:0@lo:400: 00000100:00100000:3.0:1788909068.047926:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909068.047967:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019477760:0@lo:400: 00000100:00100000:3.0:1788909068.047991:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909068.048028:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019477632 00000100:00100000:3.0:1788909068.048039:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019477632 00000100:00100000:3.0:1788909068.048072:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019477760 00000100:00100000:3.0:1788909068.048075:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019477760 00000100:00100000:3.0:1788909068.048102:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788909068.048129:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019477632:12345-0@lo:400: 00000100:00100000:3.0:1788909068.048180:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019477632:12345-0@lo:400: Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909068.048187:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788909068.048202:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788909068.048208:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019477760:12345-0@lo:400: 00000100:00100000:3.0:1788909068.048252:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019477760:12345-0@lo:400: Request processed in 44us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909068.048258:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788909068.048428:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905064d4380 x1875807019477760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909068.048442:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019477760:0@lo:400: 00010000:00080000:3.0:1788909068.048475:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905064d6680 x1875807019477632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909068.048557:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019477632:0@lo:400: 00000100:00100000:1.0:1788909068.048811:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019477504 00000100:00100000:1.0:1788909068.048877:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019477504 00000100:00100000:1.0:1788909068.048923:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788909068.048931:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:7148:x1875807019477504:12345-0@lo:502: 00000100:00100000:1.0:1788909068.049500:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:7148:x1875807019477504:12345-0@lo:502: Request processed in 568us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909068.049508:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788909068.049751:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875807019477376:12345-0@lo:8: Request processed in 3004us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909068.049774:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788909068.049913:0:7148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:7148:1875807019477504:0@lo:502: 00000020:01000000:3.0:1788909068.049945:0:7148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909068.049952:0:7148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909068.049954:0:7148:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788909068.049958:0:7148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00010000:00080000:2.0:1788909068.050441:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905064d7800 x1875807019477376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788909078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909068.050456:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788909068.050465:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788909068.050474:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788909068.050556:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788909068.050561:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89052d670000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788909068.050586:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788909068.050594:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019477376:0@lo:8: 00000100:00080000:2.0:1788909068.050629:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788909068.050679:0:7151:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788909068.050931:0:7151:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 150124819718ns, next at 0ns, rc = 0 00000020:01000000:0.0:1788909068.051265:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788909068.051307:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788909068.051319:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909068.051332:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909068.051670:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788909068.051673:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff890508884d28 from 1 10000000:01000000:1.0:1788909068.051677:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788909068.051717:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909068.051726:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909068.051736:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909068.051759:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019477888:0@lo:101: 00000100:00100000:1.0:1788909068.052211:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909068.052431:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085d1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788909068.059710:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019477888 00000100:00100000:3.0:1788909068.059732:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019477888 00000100:00100000:3.0:1788909068.059821:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788909068.059840:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019477888:12345-0@lo:101: 00010000:00010000:3.0:1788909068.059862:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909068.059884:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d549a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909068.059918:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d549a expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909068.059930:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d549a expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909068.059941:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9000, rc 0) 00000100:00100000:3.0:1788909068.060036:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019477888:12345-0@lo:101: Request processed in 203us (8205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909068.060043:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788909068.062818:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019477888:0@lo:101: 00010000:00010000:1.0:1788909068.062864:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909068.062880:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909068.062979:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019478016:0@lo:501: 00000100:00100000:1.0:1788909068.063047:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909068.063091:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085d1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788909068.063470:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019478016 00000100:00100000:0.0:1788909068.064272:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019478016 00000100:00100000:0.0:1788909068.064415:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788909068.064425:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019478016:12345-0@lo:501: 00000100:00100000:0.0:1788909068.064767:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019478016:12345-0@lo:501: Request processed in 342us (1718us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788909068.064776:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788909068.067314:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019478016:0@lo:501: 10000000:01000000:2.0:1788909068.067374:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788909068.067403:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909068.067417:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788909068.096349:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788909068.096707:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:3.0:1788909068.096730:0:7152:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788909068.096765:0:7152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1875807019478272:0@lo:7: 00000100:00100000:3.0:1788909068.097022:0:7152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909068.097086:0:7152:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508875c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788909068.097163:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019478272 00000100:00100000:0.0:1788909068.097173:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019478272 00000100:00100000:0.0:1788909068.097252:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788909068.097262:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7152:x1875807019478272:12345-0@lo:7: 00000100:00080000:3.0:1788909068.099424:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788909068.099966:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019478144:0@lo:13: 00000100:00100000:2.0:1788909068.100059:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909068.103953:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019478144 00000100:00100000:3.0:1788909068.103970:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019478144 00000100:00100000:3.0:1788909068.104123:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788909068.104147:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875807019478144:12345-0@lo:13: 00002000:00000024:3.0:1788909068.104182:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788909068.104301:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875807019478144:12345-0@lo:13: Request processed in 158us (4231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909068.104320:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788909068.104412:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905064d5f80 x1875807019478144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909068.104433:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019478144:0@lo:13: 00002000:00080000:0.0:1788909068.105640:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788909068.105655:0:6676:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788909068.105753:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7152:x1875807019478272:12345-0@lo:7: Request processed in 8489us (8727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909068.105762:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788909068.106183:0:7152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905064d6680 x1875807019478272/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788909084 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909068.106201:0:7152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1875807019478272:0@lo:7: 00000004:00080000:1.0:1788909068.106232:0:7152:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788909068.106277:0:7152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1875807019478400:0@lo:5: 00000100:00100000:1.0:1788909068.106334:0:7152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909068.106371:0:7152:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085d1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788909068.106524:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019478400 00000100:00100000:0.0:1788909068.106532:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019478400 00000100:00100000:0.0:1788909068.106693:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788909068.106705:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7152:x1875807019478400:12345-0@lo:5: 00002000:00080000:0.0:1788909068.106739:0:6673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788909068.106743:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788909068.107464:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7152:x1875807019478400:12345-0@lo:5: Request processed in 759us (1127us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788909068.107471:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788909068.107521:0:7152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89051175f800 x1875807019478400/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788909084 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909068.107536:0:7152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1875807019478400:0@lo:5: 00000004:00080000:0.0:1788909068.107548:0:7152:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788909068.107579:0:7152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1875807019478528:0@lo:700: 00000100:00100000:0.0:1788909068.107611:0:7152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909068.107934:0:7152:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506794b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909068.108159:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019478528 00000100:00100000:3.0:1788909068.108166:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019478528 00000100:00100000:3.0:1788909068.108439:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788909068.108451:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7152:x1875807019478528:12345-0@lo:700: 00000100:00100000:3.0:1788909068.108498:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6682:1875807019478656:0@lo:700: 00000100:00100000:3.0:1788909068.108541:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909068.108569:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508875300 going to sleep for 11 seconds 00000100:00100000:0.0:1788909068.108661:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019478656 00000100:00100000:0.0:1788909068.108665:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019478656 00000100:00100000:0.0:1788909068.108702:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788909068.108709:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6682:x1875807019478656:12345-0@lo:700: 40000000:02000000:1.0:1788909068.174930:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788909068.181734:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6682:x1875807019478656:12345-0@lo:700: Request processed in 73015us (73183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909068.181778:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788909068.181921:0:6682:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905064d6d80 x1875807019478656/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788909084 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909068.181937:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6682:1875807019478656:0@lo:700: 40000000:02000000:3.0:1788909068.181951:0:6682:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1788909068.262737:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788909068.262765:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788909068.263186:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7152:x1875807019478528:12345-0@lo:700: Request processed in 154727us (155564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909068.263210:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788909068.263349:0:7152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890510386a00 x1875807019478528/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788909084 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909068.264765:0:7152:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788909068.264812:0:7152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1875807019478528:0@lo:700: 00000004:02000040:3.0:1788909068.294806:0:7152:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788909068.299338:0:7152:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1875807019478784:0@lo:5: 00000100:00100000:3.0:1788909068.299434:0:7152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909068.299595:0:7152:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905088756c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909068.299730:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019478784 00000100:00100000:0.0:1788909068.299740:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019478784 00000100:00100000:0.0:1788909068.300036:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788909068.300049:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7152:x1875807019478784:12345-0@lo:5: 00002000:00080000:1.0:1788909068.307052:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788909068.307078:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788909068.311576:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7152:x1875807019478784:12345-0@lo:5: Request processed in 11521us (12132us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788909068.311612:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788909068.311700:0:7152:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905064d6d80 x1875807019478784/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788909084 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909068.311724:0:7152:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7152:1875807019478784:0@lo:5: 00000004:00080000:3.0:1788909068.311744:0:7152:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788909068.999149:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909070.021727:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788909070.795539:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788909071.045375:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909072.070368:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909073.095080:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909073.542276:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019478912:0@lo:13: 00000100:00100000:3.0:1788909073.542361:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909073.542575:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019478912 00000100:00100000:3.0:1788909073.542599:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019478912 00000100:00100000:3.0:1788909073.542666:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788909073.542677:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019478912:12345-0@lo:13: 00002000:00000024:3.0:1788909073.542719:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909073.542782:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019478912:12345-0@lo:13: Request processed in 107us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909073.542789:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788909073.542814:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019479040:0@lo:400: 00000100:00100000:3.0:1788909073.542848:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788909073.542903:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89051175d180 x1875807019478912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909073.542914:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788909073.543131:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019479168:0@lo:400: 00000100:00100000:1.0:1788909073.543165:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909073.543198:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909073.543204:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019479296:0@lo:400: 00000100:00100000:1.0:1788909073.543230:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909073.543825:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019478912:0@lo:13: 00000100:00080000:3.0:1788909073.543858:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909073.543878:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019479040 00000100:00100000:3.0:1788909073.543884:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019479040 00000100:00100000:3.0:1788909073.544006:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788909073.544019:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:3286:x1875807019479040:12345-0@lo:400: 00000100:00100000:3.0:1788909073.544084:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:3286:x1875807019479040:12345-0@lo:400: Request processed in 68us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909073.544092:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788909073.544141:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019479168 00000100:00100000:3.0:1788909073.544145:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019479168 00000100:00100000:3.0:1788909073.544170:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019479296 00000100:00100000:3.0:1788909073.544173:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019479296 00000100:00100000:3.0:1788909073.544196:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788909073.544203:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019479168:12345-0@lo:400: 00000100:00100000:3.0:1788909073.544255:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019479168:12345-0@lo:400: Request processed in 53us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909073.544262:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788909073.544276:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788909073.544283:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019479296:12345-0@lo:400: 00000100:00100000:3.0:1788909073.544311:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019479296:12345-0@lo:400: Request processed in 29us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909073.544317:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788909073.544350:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019479040:0@lo:400: 00000100:00080000:3.0:1788909073.544370:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788909073.544391:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905064d7100 x1875807019479296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909073.544402:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019479296:0@lo:400: 00010000:00080000:3.0:1788909073.544413:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905064d7800 x1875807019479168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909073.544421:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019479168:0@lo:400: 00010000:00010000:0.0:1788909074.122583:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909075.142092:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909076.165274:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788909076.948420:0:7625:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788909076.948424:0:7625:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788909076.948564:0:7625:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8905375be800 00000020:01000004:3.0:1788909076.948579:0:7625:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788909076.948591:0:7625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788909076.948604:0:7625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89053cc50000) 00000020:00000080:3.0:1788909076.948618:0:7625:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788909076.973438:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788909076.973849:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788909076.991422:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788909076.999656:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788909076.999693:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788909076.999769:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788909076.999800:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788909077.000215:0:7625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788909077.000227:0:7625:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788909077.000278:0:7625:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x733cfdd8721d54af 00000020:01000004:3.0:1788909077.000304:0:7625:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788909077.000327:0:7625:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788909077.000331:0:7625:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788909077.000336:0:7625:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788909077.000357:0:7625:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788909077.000361:0:7625:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788909077.017514:0:7625:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788909077.017554:0:7625:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788909077.017558:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788909077.017560:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788909077.017561:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788909077.017562:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788909077.017564:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788909077.017565:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788909077.017567:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788909077.017568:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788909077.017569:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788909077.017571:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788909077.017572:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788909077.017577:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788909077.017579:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788909077.017580:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788909077.017581:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788909077.017582:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788909077.017583:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788909077.017584:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788909077.017585:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788909077.017586:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788909077.017587:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788909077.017588:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788909077.017592:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788909077.017627:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788909077.017646:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019479424:0@lo:253: 00000100:00100000:3.0:1788909077.017719:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909077.017920:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019479424 00000100:00100000:0.0:1788909077.017930:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019479424 00000100:00100000:0.0:1788909077.018003:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788909077.018015:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:7625:x1875807019479424:12345-0@lo:253: 20000000:01000000:0.0:1788909077.018057:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788909077.018061:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788909077.018066:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788909077.018070:0:5816:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788909077.019072:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788909077.019330:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788909077.019346:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788909077.019387:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788909077.019395:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788909077.019426:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788909077.019478:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788909077.019827:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788909077.019853:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:0.0:1788909077.019855:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788909077.019888:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788909077.019894:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788909077.019933:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788909077.019940:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:0.0:1788909077.019978:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788909077.019987:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788909077.020014:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788909077.020053:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000100:00100000:3.0:1788909077.020891:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2c00 going to sleep for 11 seconds 00000040:00080000:0.0:1788909077.021435:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788909077.021457:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.154@tcp 20000000:01000000:0.0:1788909077.021460:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788909077.021493:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788909077.021500:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788909077.021529:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788909077.021536:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.154@tcp (null) (null) 00000040:00080000:0.0:1788909077.021569:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788909077.021578:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788909077.021623:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788909077.021737:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788909077.021757:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788909077.021760:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788909077.021767:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788909077.021768:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788909077.021770:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788909077.021783:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788909077.021786:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788909077.021820:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788909077.021823:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788909077.022597:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788909077.022741:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788909077.022808:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788909077.023344:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788909077.023385:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788909077.023463:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788909077.023476:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788909077.023479:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788909077.023983:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788909077.024308:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788909077.024368:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788909077.024448:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788909077.024462:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788909077.024464:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788909077.025091:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788909077.025329:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788909077.025371:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788909077.025639:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788909077.025772:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788909077.025833:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788909077.025846:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788909077.025848:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788909077.026395:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788909077.026454:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788909077.026506:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788909077.026900:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788909077.026945:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788909077.026998:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:0.0:1788909077.027018:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788909077.027038:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027058:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5400 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027066:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d542a expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027073:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5454 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027079:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5470 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027086:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d549a expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027099:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027241:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d549a expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027256:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d549a expref: 16 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909077.027270:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019479552:0@lo:104: 00000100:00100000:0.0:1788909077.027596:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788909077.027658:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d5470 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027667:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d5470 expref: 16 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909077.027676:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019479680:0@lo:104: 00010000:00010000:0.0:1788909077.027705:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d5454 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027713:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d5454 expref: 16 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909077.027722:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019479808:0@lo:104: 00010000:00010000:0.0:1788909077.027747:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d542a expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.027754:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d542a expref: 16 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909077.027767:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788909077.027771:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019479936:0@lo:104: 00000100:00100000:3.0:1788909077.027785:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.027913:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019479552 00000100:00100000:2.0:1788909077.027926:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019479552 00000100:00100000:2.0:1788909077.027988:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019479680 00000100:00100000:2.0:1788909077.027992:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019479680 00000100:00100000:2.0:1788909077.028009:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788909077.028021:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+4:5816:x1875807019479552:12345-0@lo:104: 00010000:00010000:2.0:1788909077.028038:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909077.028085:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788909077.028127:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d5400 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.028137:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d5400 expref: 16 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909077.028147:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019480064:0@lo:104: 00000100:00100000:0.0:1788909077.028171:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909077.028182:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff890533d256c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909077.028260:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909077.028269:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788909077.028276:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788909077.028519:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019479936 00000100:00100000:3.0:1788909077.028524:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019479936 00000100:00100000:3.0:1788909077.028544:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788909077.028550:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019480064 00000100:00100000:3.0:1788909077.028552:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019480064 00000100:00100000:3.0:1788909077.028562:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788909077.028566:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019479808 00000100:00100000:3.0:1788909077.028568:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019479808 00010000:00010000:2.0:1788909077.028692:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788909077.028699:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+7:5816:x1875807019479552:12345-0@lo:104: Request processed in 680us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.028721:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788909077.028762:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788909077.028771:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+6:5816:x1875807019479680:12345-0@lo:104: 00010000:00010000:2.0:1788909077.028779:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.028811:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788909077.028816:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+6:5816:x1875807019479680:12345-0@lo:104: Request processed in 48us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.028821:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788909077.028832:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788909077.028838:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+5:5816:x1875807019479936:12345-0@lo:104: 00010000:00010000:2.0:1788909077.028845:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.028874:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788909077.028879:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+5:5816:x1875807019479936:12345-0@lo:104: Request processed in 42us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.028885:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788909077.028898:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788909077.028905:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+4:5816:x1875807019480064:12345-0@lo:104: 00010000:00010000:2.0:1788909077.028912:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.028937:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788909077.028942:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+4:5816:x1875807019480064:12345-0@lo:104: Request processed in 38us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.028954:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788909077.028979:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788909077.028985:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+3:5816:x1875807019479808:12345-0@lo:104: 00010000:00010000:2.0:1788909077.028993:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029019:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788909077.029023:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+3:5816:x1875807019479808:12345-0@lo:104: Request processed in 39us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.029028:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788909077.029045:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788909077.029050:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029057:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693c00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909077.029061:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029069:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909077.029077:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909077.029082:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909077.029130:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029137:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909077.029161:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029168:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501693c00/0x733cfdd8721d549a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54a1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029182:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788909077.029185:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029190:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ca00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909077.029193:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029199:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909077.029204:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909077.029209:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909077.029219:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029224:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909077.029228:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029233:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d5470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5477 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029239:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788909077.029247:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029253:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692a00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909077.029256:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029261:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909077.029266:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909077.029270:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909077.029281:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029286:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909077.029301:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029308:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501692a00/0x733cfdd8721d542a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5431 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029318:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788909077.029321:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029327:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909077.029329:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029345:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909077.029352:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909077.029357:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909077.029370:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029376:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909077.029381:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029387:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890504d9c200/0x733cfdd8721d5400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5407 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029397:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909077.029401:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029407:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9dc00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909077.029410:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029416:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909077.029423:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909077.029433:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909077.029446:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029452:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909077.029456:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029462:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890504d9dc00/0x733cfdd8721d5454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d545b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029475:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909077.029477:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909077.029479:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909077.029486:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909077.029505:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019480192:0@lo:103: 00000100:00100000:2.0:1788909077.029540:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.029574:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019480704:0@lo:103: 00000100:00100000:2.0:1788909077.029595:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.029614:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909077.029619:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019480320:0@lo:103: 00000100:00100000:2.0:1788909077.029638:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.029664:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019480448:0@lo:103: 00000100:00100000:2.0:1788909077.029685:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.029698:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788909077.029702:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019480576:0@lo:103: 00000100:00100000:2.0:1788909077.029739:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.029778:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019480192 00000100:00100000:2.0:1788909077.029784:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019480192 00010000:00010000:2.0:1788909077.029806:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d549a expref: 17 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909077.029821:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019480704 00000100:00100000:2.0:1788909077.029824:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019480704 00010000:00010000:2.0:1788909077.029833:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5454 expref: 18 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909077.029843:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019480320 00000100:00100000:2.0:1788909077.029845:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019480320 00010000:00010000:2.0:1788909077.029854:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5470 expref: 19 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909077.029865:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019480448 00000100:00100000:2.0:1788909077.029868:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019480448 00010000:00010000:2.0:1788909077.029877:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d542a expref: 20 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909077.029885:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019480576 00000100:00100000:2.0:1788909077.029887:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019480576 00010000:00010000:2.0:1788909077.029895:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5400 expref: 21 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909077.029907:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788909077.029914:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+21:3285:x1875807019480192:12345-0@lo:103: 00010000:00010000:2.0:1788909077.029925:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909077.029931:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d549a expref: 21 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029942:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d549a expref: 21 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.029979:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909077.030013:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+21:3285:x1875807019480192:12345-0@lo:103: Request processed in 99us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.030020:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788909077.030036:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788909077.030043:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+20:3285:x1875807019480704:12345-0@lo:103: 00010000:00010000:2.0:1788909077.030051:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909077.030056:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5454 expref: 20 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030064:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d5454 expref: 20 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030074:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909077.030097:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+20:3285:x1875807019480704:12345-0@lo:103: Request processed in 54us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.030103:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788909077.030138:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788909077.030145:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019480320:12345-0@lo:103: 00010000:00010000:2.0:1788909077.030153:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909077.030157:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5470 expref: 19 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030167:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d5470 expref: 19 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030176:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909077.030198:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019480320:12345-0@lo:103: Request processed in 53us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.030211:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788909077.030223:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788909077.030229:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+18:3283:x1875807019480448:12345-0@lo:103: 00010000:00010000:2.0:1788909077.030237:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909077.030241:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d542a expref: 18 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030250:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d542a expref: 18 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030259:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909077.030288:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+18:3283:x1875807019480448:12345-0@lo:103: Request processed in 59us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.030294:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788909077.030306:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788909077.030311:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+17:3283:x1875807019480576:12345-0@lo:103: 00010000:00010000:2.0:1788909077.030318:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909077.030322:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5400 expref: 17 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030329:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d5400 expref: 17 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030340:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030347:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030366:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030373:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030379:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030385:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030390:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9de00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909077.030394:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030401:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030408:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.030417:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909077.030437:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+17:3283:x1875807019480576:12345-0@lo:103: Request processed in 126us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.030442:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788909077.030487:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019480576:0@lo:103: 00000100:00100000:2.0:1788909077.030495:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019480448:0@lo:103: 00000100:00100000:2.0:1788909077.030523:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019480320:0@lo:103: 00000100:00100000:2.0:1788909077.030540:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019480192:0@lo:103: 00000100:00100000:2.0:1788909077.030547:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019480704:0@lo:103: 00010000:00010000:3.0:1788909077.030795:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad9000/0x733cfdd8721d54a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d549a expref: 16 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909077.030813:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019479552:0@lo:104: 00010000:00010000:3.0:1788909077.030826:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501693a00/0x733cfdd8721d5477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d5470 expref: 15 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909077.030846:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019479680:0@lo:104: 00010000:00010000:3.0:1788909077.030860:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501692600/0x733cfdd8721d545b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d5454 expref: 14 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909077.030868:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019479808:0@lo:104: 00010000:00010000:3.0:1788909077.030879:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501535400/0x733cfdd8721d5431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d542a expref: 13 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909077.030888:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019479936:0@lo:104: 00010000:00010000:3.0:1788909077.030896:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501534600/0x733cfdd8721d5407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d5400 expref: 12 pid: 5817 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909077.030905:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5816:1875807019480064:0@lo:104: 00010000:00010000:3.0:1788909077.030934:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.030943:0:5816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.030949:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.030955:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9de00/0x733cfdd8721d54b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788909077.030998:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1788909077.031096:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909077.084018:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+11:7625:x1875807019479424:12345-0@lo:253: Request processed in 65993us (66286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909077.084056:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788909077.084206:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019479424:0@lo:253: 10000000:01000000:1.0:1788909077.084224:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788909077.084228:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788909077.084231:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788909077.084232:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788909077.084233:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788909077.084235:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788909077.084236:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788909077.084238:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788909077.084240:0:7625:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788909077.084242:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788909077.084243:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788909077.084270:0:7625:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8905375be800 from lustre-OST0001 10000000:01000000:1.0:1788909077.084303:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788909077.084307:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788909077.084315:0:7625:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890508884d28 local copy 10000000:01000000:1.0:1788909077.084320:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788909077.084362:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.084373:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.084383:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909077.084402:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019480832:0@lo:101: 00000100:00100000:1.0:1788909077.084447:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909077.084573:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979240 going to sleep for 11 seconds 00000100:00100000:0.0:1788909077.084752:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019480832 00000100:00100000:0.0:1788909077.084760:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019480832 00000100:00100000:0.0:1788909077.084844:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788909077.084854:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+11:7625:x1875807019480832:12345-0@lo:101: 00010000:00010000:0.0:1788909077.084867:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909077.084884:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9d800/0x733cfdd8721d54c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d54bd expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.084911:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9d800/0x733cfdd8721d54c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d54bd expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.084922:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9d800/0x733cfdd8721d54c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d54bd expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.084931:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d800, rc 0) 00000100:00100000:0.0:1788909077.084983:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:7625:x1875807019480832:12345-0@lo:101: Request processed in 131us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909077.084998:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788909077.085068:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019480832:0@lo:101: 00010000:00010000:3.0:1788909077.085081:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.085090:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909077.085217:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019480960:0@lo:501: 00000100:00100000:3.0:1788909077.085246:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909077.085399:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.085474:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019480960 00000100:00100000:1.0:1788909077.085479:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019480960 00000100:00100000:1.0:1788909077.085501:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788909077.085507:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:7625:x1875807019480960:12345-0@lo:501: 00000100:00100000:1.0:1788909077.085862:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:7625:x1875807019480960:12345-0@lo:501: Request processed in 353us (614us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788909077.085870:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788909077.086010:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019480960:0@lo:501: 10000000:01000000:3.0:1788909077.086028:0:7625:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788909077.086056:0:7625:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788909077.086062:0:7625:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.086071:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.086078:0:7625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.086152:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788909077.086175:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8905375be800 10000000:01000000:3.0:1788909077.086180:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788909077.086186:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788909077.086195:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788909077.086200:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788909077.086203:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788909077.086225:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.086233:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.086241:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909077.086256:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481088:0@lo:101: 00000100:00100000:3.0:1788909077.086284:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909077.086313:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.086373:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019481088 00000100:00100000:1.0:1788909077.086379:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019481088 00000100:00100000:1.0:1788909077.086410:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788909077.086417:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:7625:x1875807019481088:12345-0@lo:101: 00010000:00010000:1.0:1788909077.086425:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909077.086435:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d54cb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.086452:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d54cb expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.086462:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d54cb expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.086470:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692c00, rc 0) 00000100:00100000:1.0:1788909077.086505:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481088:12345-0@lo:101: Request processed in 88us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909077.086510:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788909077.086580:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481088:0@lo:101: 00010000:00010000:3.0:1788909077.086592:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.086600:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909077.086670:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481216:0@lo:501: 00000100:00100000:3.0:1788909077.086694:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909077.086717:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.086831:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019481216 00000100:00100000:1.0:1788909077.086835:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019481216 00000100:00100000:1.0:1788909077.086864:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788909077.086881:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481216:12345-0@lo:501: 00000100:00100000:1.0:1788909077.087279:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481216:12345-0@lo:501: Request processed in 398us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909077.087286:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788909077.087324:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481216:0@lo:501: 00000100:00100000:1.0:1788909077.087356:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481344:0@lo:503: 00000100:00100000:1.0:1788909077.087395:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909077.087418:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979540 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.087430:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019481344 00000100:00100000:1.0:1788909077.087433:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019481344 00000100:00100000:1.0:1788909077.087449:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788909077.087455:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481344:12345-0@lo:503: 00000100:00100000:1.0:1788909077.087595:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481344:12345-0@lo:503: Request processed in 139us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909077.087602:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788909077.087645:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481344:0@lo:503: 00000040:00080000:1.0:1788909077.088058:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788909077.088151:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481472:0@lo:502: 00000100:00100000:1.0:1788909077.088189:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909077.088215:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979540 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.088232:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019481472 00000100:00100000:1.0:1788909077.088235:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019481472 00000100:00100000:1.0:1788909077.088254:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788909077.088260:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481472:12345-0@lo:502: 00000100:00100000:1.0:1788909077.088417:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481472:12345-0@lo:502: Request processed in 156us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909077.088433:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788909077.088479:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481472:0@lo:502: 00000040:00080000:1.0:1788909077.088943:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788909077.089008:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788909077.089045:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788909077.089094:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788909077.089215:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788909077.089247:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788909077.089276:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481600:0@lo:502: 00000100:00100000:1.0:1788909077.089322:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909077.089403:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979540 going to sleep for 11 seconds 00010000:00010000:2.0:1788909077.089485:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909077.089494:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.089504:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909077.089509:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.089518:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909077.089526:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909077.089532:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909077.089555:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.089562:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909077.089579:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.089586:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501693200/0x733cfdd8721d54bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x733cfdd8721d54c4 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.089598:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909077.089600:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909077.089608:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909077.089620:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019481728:0@lo:103: 00000100:00100000:2.0:1788909077.089876:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909077.089981:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019481728 00000100:00100000:3.0:1788909077.089989:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019481728 00000100:00100000:3.0:1788909077.090052:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788909077.090063:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+13:3286:x1875807019481728:12345-0@lo:103: 00010000:00010000:3.0:1788909077.090086:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909077.090105:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9d800/0x733cfdd8721d54c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d54bd expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909077.090140:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909077.090188:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+12:3286:x1875807019481728:12345-0@lo:103: Request processed in 127us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909077.090195:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788909077.090281:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019481728:0@lo:103: 00000100:00100000:0.0:1788909077.090439:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019481600 00000100:00100000:0.0:1788909077.090445:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019481600 00000100:00100000:0.0:1788909077.090518:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788909077.090526:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+12:7625:x1875807019481600:12345-0@lo:502: 00000100:00100000:0.0:1788909077.090815:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+12:7625:x1875807019481600:12345-0@lo:502: Request processed in 290us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909077.090822:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788909077.090906:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481600:0@lo:502: 00000040:00080000:2.0:1788909077.091054:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788909077.091070:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788909077.092749:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788909077.092761:0:7633:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788909077.092768:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909077.092770:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788909077.092775:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788909077.092792:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89052d653370) 00000020:00000080:2.0:1788909077.092817:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788909077.092825:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788909077.092885:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8905375be800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788909077.092893:0:7633:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788909077.092900:0:7633:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x733cfdd8721d54e0 00010000:00010000:2.0:1788909077.097359:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788909077.097852:0:7633:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788909077.100918:0:7633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788909077.101487:0:7633:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788909077.106579:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788909077.107271:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788909077.108913:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788909077.108925:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909077.108931:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909077.108933:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788909077.108936:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909077.108940:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909077.108942:0:7633:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788909077.108944:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788909077.108946:0:7633:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788909077.109014:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909077.109018:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909077.109020:0:7633:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788909077.109022:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788909077.109226:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788909077.109254:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788909077.109279:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.109291:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909077.109313:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905375be800 from 1 10000000:01000000:2.0:1788909077.109315:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788909077.109347:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.109354:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.109365:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909077.109385:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481856:0@lo:101: 00000100:00100000:2.0:1788909077.109453:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.109489:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506943900 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.109554:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019481856 00000100:00100000:1.0:1788909077.109562:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019481856 00000100:00100000:1.0:1788909077.109620:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788909077.109630:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+12:7625:x1875807019481856:12345-0@lo:101: 00010000:00010000:1.0:1788909077.109643:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909077.109665:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d54e7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.109689:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d54e7 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.109708:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d54e7 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.109717:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693000, rc 0) 00000100:00100000:1.0:1788909077.109755:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481856:12345-0@lo:101: Request processed in 126us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909077.109770:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788909077.110026:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481856:0@lo:101: 00010000:00010000:2.0:1788909077.110042:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.110053:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909077.110199:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481984:0@lo:501: 00000100:00100000:2.0:1788909077.110229:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.110254:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506943900 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.110347:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019481984 00000100:00100000:1.0:1788909077.110352:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019481984 00000100:00100000:1.0:1788909077.110386:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788909077.110393:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481984:12345-0@lo:501: 00000100:00100000:1.0:1788909077.110620:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019481984:12345-0@lo:501: Request processed in 226us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909077.110627:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788909077.110868:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019481984:0@lo:501: 00000100:00100000:2.0:1788909077.110902:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482112:0@lo:503: 00000100:00100000:2.0:1788909077.110955:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.110989:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506943900 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.111036:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019482112 00000100:00100000:1.0:1788909077.111041:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019482112 00000100:00100000:1.0:1788909077.111078:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788909077.111087:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019482112:12345-0@lo:503: 00000100:00100000:1.0:1788909077.111558:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019482112:12345-0@lo:503: Request processed in 471us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909077.111567:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788909077.111860:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482112:0@lo:503: 00000040:00080000:2.0:1788909077.112237:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788909077.112325:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482240:0@lo:502: 00000100:00100000:2.0:1788909077.112373:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.112417:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506943900 going to sleep for 11 seconds 00000100:00100000:3.0:1788909077.112486:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019482240 00000100:00100000:3.0:1788909077.112493:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019482240 00000100:00100000:3.0:1788909077.112532:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788909077.112541:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019482240:12345-0@lo:502: 00000100:00100000:3.0:1788909077.112900:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019482240:12345-0@lo:502: Request processed in 359us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909077.112908:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788909077.113414:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482240:0@lo:502: 00000040:00080000:1.0:1788909077.113991:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788909077.114050:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788909077.114853:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482368:0@lo:502: 00000100:00100000:1.0:1788909077.114925:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909077.114985:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909077.115339:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019482368 00000100:00100000:3.0:1788909077.115346:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019482368 00000100:00100000:3.0:1788909077.115402:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788909077.115410:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019482368:12345-0@lo:502: 00000100:00100000:3.0:1788909077.115608:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019482368:12345-0@lo:502: Request processed in 197us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909077.115615:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788909077.115871:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482368:0@lo:502: 00000040:00080000:0.0:1788909077.116012:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788909077.116026:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788909077.120521:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909077.120535:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909077.120537:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788909077.120545:0:7636:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8905375be800 00000020:00000080:0.0:1788909077.120548:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788909077.120571:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909077.120575:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909077.120577:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788909077.120580:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788909077.120945:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788909077.120991:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788909077.121022:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.121037:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909077.121137:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788909077.121141:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8905375be800 10000000:01000000:1.0:1788909077.121145:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8905375be800 10000000:01000000:1.0:1788909077.121150:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788909077.121157:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905375be800 from 1 10000000:01000000:1.0:1788909077.121160:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788909077.121198:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.121206:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.121218:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909077.121241:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482496:0@lo:101: 00000100:00100000:1.0:1788909077.121314:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909077.121359:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909077.121512:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019482496 00000100:00100000:0.0:1788909077.121520:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019482496 00000100:00100000:0.0:1788909077.121570:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788909077.121579:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019482496:12345-0@lo:101: 00010000:00010000:0.0:1788909077.121593:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909077.121605:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d54f5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.121640:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d54f5 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.121651:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d54f5 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.121837:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ce00, rc 0) 00000100:00100000:0.0:1788909077.122035:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019482496:12345-0@lo:101: Request processed in 456us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909077.122042:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788909077.122165:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482496:0@lo:101: 00010000:00010000:1.0:1788909077.122179:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.122188:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909077.122285:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482624:0@lo:501: 00000100:00100000:1.0:1788909077.122315:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909077.122354:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909077.122427:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019482624 00000100:00100000:3.0:1788909077.122432:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019482624 00000100:00100000:3.0:1788909077.122456:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788909077.122464:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019482624:12345-0@lo:501: 00000100:00100000:3.0:1788909077.123132:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019482624:12345-0@lo:501: Request processed in 645us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909077.123141:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788909077.123244:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482624:0@lo:501: 00000100:00100000:0.0:1788909077.123280:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482752:0@lo:503: 00000100:00100000:0.0:1788909077.123325:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909077.123355:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890507effa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909077.123404:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019482752 00000100:00100000:3.0:1788909077.123409:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019482752 00000100:00100000:3.0:1788909077.123443:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788909077.123451:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019482752:12345-0@lo:503: 00000100:00100000:3.0:1788909077.123605:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019482752:12345-0@lo:503: Request processed in 154us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909077.123612:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788909077.123669:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482752:0@lo:503: 00000040:00080000:3.0:1788909077.124153:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788909077.124222:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482880:0@lo:502: 00000100:00100000:3.0:1788909077.124266:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909077.124285:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909077.124302:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019482880 00000100:00100000:3.0:1788909077.124307:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019482880 00000100:00100000:3.0:1788909077.124327:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788909077.124345:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019482880:12345-0@lo:502: 00000100:00100000:3.0:1788909077.124520:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019482880:12345-0@lo:502: Request processed in 175us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909077.124526:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788909077.124572:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019482880:0@lo:502: 00000040:00080000:3.0:1788909077.126354:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788909077.126460:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788909077.126499:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788909077.126547:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788909077.126590:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788909077.126664:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788909077.128235:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788909077.128307:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788909077.128394:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788909077.128431:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788909077.128464:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788909077.128511:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788909077.128549:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788909077.128582:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788909077.128631:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788909077.128667:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788909077.128695:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788909077.128752:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788909077.128786:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788909077.128817:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788909077.128866:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788909077.128906:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788909077.128941:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788909077.129003:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788909077.129040:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788909077.129071:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788909077.131355:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788909077.131451:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788909077.131487:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788909077.131538:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788909077.131578:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788909077.131611:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788909077.131645:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788909077.132567:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788909077.132623:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788909077.132808:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788909077.132851:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788909077.132904:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019483008:0@lo:502: 00000100:00100000:3.0:1788909077.132999:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909077.133056:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909077.133319:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019483008 00000100:00100000:0.0:1788909077.133328:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019483008 00000100:00100000:0.0:1788909077.133383:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788909077.133394:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019483008:12345-0@lo:502: 00000100:00100000:0.0:1788909077.133623:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019483008:12345-0@lo:502: Request processed in 230us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909077.133631:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788909077.133880:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019483008:0@lo:502: 00000040:00080000:3.0:1788909077.133989:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788909077.134001:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788909077.136470:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788909077.136488:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89052d6519b8) 00000020:00000080:2.0:1788909077.136509:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788909077.136604:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8905375be800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788909077.136608:0:7638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8905375be800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788909077.136611:0:7638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905375be800 3 00010000:00080000:2.0:1788909077.136642:0:7638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890537b21000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788909077.139567:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788909077.139988:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788909077.140032:0:7638:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788909077.140047:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x733cfdd8721d550a 00000100:00080000:2.0:1788909077.140060:0:7638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788909077.140066:0:7638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890537b21000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788909077.140238:0:7638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89053cc3bb80 x1875807019483136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788909077.140298:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875807019483136:0@lo:38: 00000100:00100000:3.0:1788909077.140381:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909077.140483:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019483136 00000100:00100000:1.0:1788909077.140491:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019483136 00000100:00100000:1.0:1788909077.140527:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788909077.140534:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875807019483136:12345-0@lo:38: 00010000:00080000:1.0:1788909077.140558:0:5824:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:1.0:1788909077.140593:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x733cfdd8721d5511 00000004:00100000:1.0:1788909077.140610:0:5824:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788909077.140644:0:5824:0:(import.c:65:import_set_state_nolock()) ffff89053cc41800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788909077.140727:0:7638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788909077.140802:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019483264:0@lo:400: 00000100:00100000:2.0:1788909077.141893:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.141939:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788909077.141949:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019483392:0@lo:400: 00000100:00100000:2.0:1788909077.142023:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.142055:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019483520:0@lo:400: 00000100:00100000:2.0:1788909077.142131:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.142170:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019483520 00000100:00100000:2.0:1788909077.142176:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019483520 00000100:00100000:2.0:1788909077.142229:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909077.142238:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019483520:12345-0@lo:400: 00000100:00100000:2.0:1788909077.142283:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019483520:12345-0@lo:400: Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.142290:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788909077.142325:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89053cc3b800 x1875807019483520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909077.142338:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019483520:0@lo:400: 00000100:00100000:2.0:1788909077.143220:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788909077.143230:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788909077.144269:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019483264 00000100:00100000:2.0:1788909077.144278:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019483264 00000100:00100000:2.0:1788909077.144312:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788909077.144318:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019483392 00000100:00100000:2.0:1788909077.144321:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019483392 00000100:00100000:2.0:1788909077.144335:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788909077.144343:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788909077.144352:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019483264:12345-0@lo:400: 00000100:00100000:2.0:1788909077.144429:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019483264:12345-0@lo:400: Request processed in 78us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.144437:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788909077.144452:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788909077.144458:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788909077.144472:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019483392:12345-0@lo:400: 00000100:00100000:2.0:1788909077.144502:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019483392:12345-0@lo:400: Request processed in 31us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.144508:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788909077.144546:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89053cc39180 x1875807019483392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909077.144560:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019483392:0@lo:400: 00010000:00080000:2.0:1788909077.144573:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89053cc3ad80 x1875807019483264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909077.144583:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019483264:0@lo:400: 00000100:00080000:2.0:1788909077.146012:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788909077.146022:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909077.150031:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875807019483136:12345-0@lo:38: Request processed in 9484us (9638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909077.150048:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1788909077.150370:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1788909077.150562:0:7639:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff89051175c380 x1875807019483648/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909077.150576:0:7639:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979cc0 going to sleep for 0 seconds 00010000:00080000:3.0:1788909077.151260:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89053cc3bb80 x1875807019483136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788909087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909077.151272:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788909077.151283:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788909077.151291:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788909077.151296:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788909077.151300:0:3282:0:(import.c:65:import_set_state_nolock()) ffff890537b21000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788909077.151308:0:3282:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007e3a163a): req@ffff89051175c380 x1875807019483648/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909077.151344:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875807019483136:0@lo:38: 00000100:00100000:1.0:1788909077.151851:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909077.151889:0:7639:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979cc0 going to sleep for 11 seconds 00000020:01000000:1.0:1788909077.152377:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788909077.152417:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788909077.152441:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.152454:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788909077.152516:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788909077.152518:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788909077.152519:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788909077.152526:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788909077.152527:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788909077.152529:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788909077.152530:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788909077.152532:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788909077.152533:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788909077.152535:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788909077.152536:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788909077.152541:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788909077.152544:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788909077.152545:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788909077.152546:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788909077.152547:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788909077.152548:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788909077.152549:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788909077.152549:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788909077.152551:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788909077.152552:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788909077.152552:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788909077.152553:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788909077.152579:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788909077.152594:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019483776:0@lo:253: 00000100:00100000:1.0:1788909077.152635:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.152951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019483648 00000100:00100000:2.0:1788909077.152971:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019483648 00000100:00080000:3.0:1788909077.153190:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909077.153370:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.153390:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019483776 00000100:00100000:1.0:1788909077.153394:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019483776 00000100:00100000:1.0:1788909077.153433:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788909077.153442:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+14:7625:x1875807019483776:12345-0@lo:253: 20000000:01000000:1.0:1788909077.153485:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788909077.153499:0:5817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788909077.154590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909077.154603:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1875807019483648:12345-0@lo:901: 00000100:00100000:2.0:1788909077.154996:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1875807019483648:12345-0@lo:901: Request processed in 395us (3145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909077.155006:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788909077.156359:0:7639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89051175c380 x1875807019483648/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788909093 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909077.156376:0:7639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1875807019483648:0@lo:901: 20000000:01000000:1.0:1788909077.190285:0:5817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788909077.190316:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788909077.190413:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788909077.190419:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788909077.190443:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.190464:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5462 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.190483:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.190523:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d5462 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909077.190537:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d5462 expref: 14 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909077.190550:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875807019483904:0@lo:104: 00000100:00100000:2.0:1788909077.190624:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909077.190687:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff89051ea46f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788909077.190863:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019483904 00000100:00100000:1.0:1788909077.190871:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019483904 00000100:00100000:1.0:1788909077.190925:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788909077.190935:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:5838:x1875807019483904:12345-0@lo:104: 00010000:00010000:1.0:1788909077.190947:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191059:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909077.191068:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191077:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d400 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909077.191229:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191239:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909077.191247:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909077.191254:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788909077.191285:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191292:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909077.191318:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191328:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890504d9d400/0x733cfdd8721d5462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5469 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191349:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909077.191351:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909077.191353:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909077.191368:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019484032:0@lo:103: 00000100:00100000:0.0:1788909077.191419:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909077.191472:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019484032 00000100:00100000:0.0:1788909077.191476:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019484032 00010000:00010000:0.0:1788909077.191497:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5462 expref: 15 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909077.191523:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788909077.191538:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905103e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de4f34ee-762f-480d-9428-329e99488659+15:3286:x1875807019484032:12345-0@lo:103: 00010000:00010000:0.0:1788909077.191549:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909077.191556:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5462 expref: 15 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191566:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d5462 expref: 15 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191583:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191592:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788909077.191608:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002152529s 00010000:00010000:0.0:1788909077.191612:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191620:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191627:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191634:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191640:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501534c00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909077.191644:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191664:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191681:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909077.191692:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909077.191992:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905103e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de4f34ee-762f-480d-9428-329e99488659+15:3286:x1875807019484032:12345-0@lo:103: Request processed in 454us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909077.192002:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788909077.193021:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788909077.193036:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:5838:x1875807019483904:12345-0@lo:104: Request processed in 2099us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909077.193048:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788909077.193208:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909077.193285:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501534000/0x733cfdd8721d5469 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d5462 expref: 14 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909077.193303:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875807019483904:0@lo:104: 00010000:00010000:1.0:1788909077.193332:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.193343:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.193349:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909077.193354:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501534c00/0x733cfdd8721d5518 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909077.193429:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019484032:0@lo:103: 00000100:00100000:3.0:1788909077.202037:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:7625:x1875807019483776:12345-0@lo:253: Request processed in 48583us (49388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909077.202056:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788909077.202273:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:de4f34ee-762f-480d-9428-329e99488659:7625:1875807019483776:0@lo:253: 10000000:01000000:0.0:1788909077.202289:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788909077.202292:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788909077.202294:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788909077.202295:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788909077.202297:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788909077.202298:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788909077.202299:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788909077.202301:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788909077.202302:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788909077.202304:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788909077.202306:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788909077.202307:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788909077.202321:0:7625:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788909077.207141:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909077.207318:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909077.207529:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909077.207850:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909077.208080:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909077.208582:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788909077.210376:0:7625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788909077.417874:0:7625:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788909077.417881:0:7625:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788909077.417920:0:7625:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788909077.417992:0:7625:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788909077.418010:0:7625:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788909077.418039:0:7625:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788909078.216794:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909078.665773:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788909078.665800:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019484160:0@lo:13: 00000100:00100000:1.0:1788909078.666256:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909078.666497:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019484160 00000100:00100000:3.0:1788909078.666505:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019484160 00000100:00100000:3.0:1788909078.666590:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788909078.666599:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019484160:12345-0@lo:13: 00002000:00000024:3.0:1788909078.666645:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909078.666701:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019484160:12345-0@lo:13: Request processed in 103us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909078.666708:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788909078.667049:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175c380 x1875807019484160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909078.667074:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019484160:0@lo:13: 00010000:00010000:0.0:1788909079.238338:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909080.261230:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909081.285364:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909082.246232:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019484416:0@lo:400: 00000100:00100000:3.0:1788909082.246310:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909082.246363:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909082.246369:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019484544:0@lo:400: 00000100:00100000:3.0:1788909082.246393:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909082.246433:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019484416 00000100:00100000:3.0:1788909082.246439:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019484416 00000100:00100000:3.0:1788909082.246473:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019484544 00000100:00100000:3.0:1788909082.246475:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019484544 00000100:00100000:3.0:1788909082.246498:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788909082.246505:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019484416:12345-0@lo:400: 00000100:00100000:3.0:1788909082.246552:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019484416:12345-0@lo:400: Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909082.246566:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788909082.246581:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788909082.246586:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019484544:12345-0@lo:400: 00000100:00100000:3.0:1788909082.246608:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019484544:12345-0@lo:400: Request processed in 23us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909082.246613:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788909082.246625:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788909082.246648:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905064d4a80 x1875807019484544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909082.246661:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019484544:0@lo:400: 00010000:00080000:3.0:1788909082.246669:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905064d5180 x1875807019484416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909082.246676:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019484416:0@lo:400: 00000100:00100000:1.0:1788909082.246764:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019484288:0@lo:400: 00000100:00100000:1.0:1788909082.246800:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909082.246829:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019484800:0@lo:400: 00000100:00100000:1.0:1788909082.246852:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909082.246882:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788909082.246887:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019484672:0@lo:400: 00000100:00100000:1.0:1788909082.246909:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909082.246936:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019484800 00000100:00100000:1.0:1788909082.246940:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019484800 00000100:00100000:1.0:1788909082.246969:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788909082.246975:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019484800:12345-0@lo:400: 00000100:00100000:1.0:1788909082.247009:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019484800:12345-0@lo:400: Request processed in 34us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909082.247014:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788909082.247032:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019484672 00000100:00100000:1.0:1788909082.247034:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019484672 00000100:00100000:1.0:1788909082.247056:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788909082.247061:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019484672:12345-0@lo:400: 00000100:00100000:1.0:1788909082.247085:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019484672:12345-0@lo:400: Request processed in 24us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909082.247089:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788909082.247104:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788909082.247136:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788909082.247152:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905064d6a00 x1875807019484672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909082.247161:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019484672:0@lo:400: 00010000:00080000:1.0:1788909082.247168:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905064d4700 x1875807019484800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909082.247174:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019484800:0@lo:400: 00000100:00100000:3.0:1788909082.247924:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019484288 00000100:00100000:3.0:1788909082.247936:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019484288 00000100:00100000:3.0:1788909082.251200:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788909082.251221:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:3284:x1875807019484288:12345-0@lo:400: 00000100:00100000:3.0:1788909082.251311:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:3284:x1875807019484288:12345-0@lo:400: Request processed in 100us (4511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909082.251318:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788909082.251420:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019484288:0@lo:400: 00010000:00010000:2.0:1788909082.309572:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788909082.850704:0:7982:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788909083.333533:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909083.781454:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788909083.784558:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019484928:0@lo:13: 00000100:00100000:2.0:1788909083.784629:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909083.789545:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019484928 00000100:00100000:3.0:1788909083.789562:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019484928 00000100:00100000:3.0:1788909083.789634:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909083.789652:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019484928:12345-0@lo:13: 00002000:00000024:3.0:1788909083.789695:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909083.789795:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019484928:12345-0@lo:13: Request processed in 144us (5165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909083.789801:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788909083.789870:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175ea00 x1875807019484928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909083.789900:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019484928:0@lo:13: 00010000:00010000:2.0:1788909084.357317:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788909084.805411:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788909084.805420:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905068d9800 from 30 10000000:01000000:2.0:1788909084.805426:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788909084.805481:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.805493:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.805505:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909084.805533:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485056:0@lo:101: 00000100:00100000:2.0:1788909084.807405:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909084.807489:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a46e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909084.808158:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019485056 00000100:00100000:3.0:1788909084.808171:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019485056 00000100:00100000:3.0:1788909084.808255:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788909084.808266:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019485056:12345-0@lo:101: 00010000:00010000:3.0:1788909084.808284:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909084.808302:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d551f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909084.808326:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d551f expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909084.808336:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d551f expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909084.808346:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9600, rc 0) 00000100:00100000:3.0:1788909084.808404:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019485056:12345-0@lo:101: Request processed in 140us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.808410:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788909084.809084:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485056:0@lo:101: 00010000:00010000:2.0:1788909084.809140:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.809152:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909084.809231:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485184:0@lo:501: 00000100:00100000:2.0:1788909084.809274:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909084.809314:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a46e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.809425:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019485184 00000100:00100000:0.0:1788909084.809430:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019485184 00000100:00100000:0.0:1788909084.809471:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788909084.809480:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019485184:12345-0@lo:501: 00000100:00100000:0.0:1788909084.810701:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019485184:12345-0@lo:501: Request processed in 1214us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.810713:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788909084.811159:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485184:0@lo:501: 00000100:00100000:2.0:1788909084.811216:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485312:0@lo:503: 00000100:00100000:2.0:1788909084.811265:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909084.811308:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a46e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.813618:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019485312 00000100:00100000:0.0:1788909084.813632:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019485312 00000100:00100000:0.0:1788909084.813717:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788909084.813738:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019485312:12345-0@lo:503: 00000100:00100000:0.0:1788909084.814364:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019485312:12345-0@lo:503: Request processed in 635us (3096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.814372:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788909084.814501:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485312:0@lo:503: 00000100:00100000:3.0:1788909084.815021:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8086:1875807019485440:0@lo:502: 00000100:00100000:3.0:1788909084.815217:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.815279:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff890510381a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.815323:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019485440 00000100:00100000:0.0:1788909084.815330:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019485440 00000100:00100000:0.0:1788909084.815375:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788909084.815384:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:8086:x1875807019485440:12345-0@lo:502: 00000100:00100000:0.0:1788909084.816006:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:8086:x1875807019485440:12345-0@lo:502: Request processed in 620us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.816015:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788909084.816186:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8086:1875807019485440:0@lo:502: 00000100:00100000:3.0:1788909084.816254:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8086:1875807019485568:0@lo:502: 00000100:00100000:3.0:1788909084.816294:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.816379:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905084cbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788909084.816429:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019485568 00000100:00100000:1.0:1788909084.816435:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019485568 00000100:00100000:1.0:1788909084.816474:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788909084.816481:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+14:8086:x1875807019485568:12345-0@lo:502: 00000100:00100000:1.0:1788909084.816765:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+14:8086:x1875807019485568:12345-0@lo:502: Request processed in 284us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909084.816771:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788909084.816963:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8086:1875807019485568:0@lo:502: 00000040:00080000:3.0:1788909084.816989:0:8086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788909084.817223:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788909084.817244:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788909084.817257:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.817268:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909084.817279:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788909084.817281:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788909084.817284:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788909084.817497:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.817506:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.817516:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909084.817531:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485696:0@lo:101: 00000100:00100000:2.0:1788909084.817664:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909084.817707:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a46e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.817778:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019485696 00000100:00100000:0.0:1788909084.817784:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019485696 00000100:00100000:0.0:1788909084.817832:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788909084.817841:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019485696:12345-0@lo:101: 00010000:00010000:0.0:1788909084.817851:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909084.817864:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d552d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.817981:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d552d expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.817992:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d552d expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.818006:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d600, rc 0) 00000100:00100000:0.0:1788909084.818060:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019485696:12345-0@lo:101: Request processed in 220us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.818066:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788909084.818464:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485696:0@lo:101: 00010000:00010000:2.0:1788909084.818487:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.818498:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909084.818633:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485824:0@lo:501: 00000100:00100000:2.0:1788909084.818664:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909084.818696:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a46e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788909084.818752:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019485824 00000100:00100000:1.0:1788909084.818758:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019485824 00000100:00100000:1.0:1788909084.818838:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788909084.818849:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019485824:12345-0@lo:501: 00000100:00100000:1.0:1788909084.819217:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019485824:12345-0@lo:501: Request processed in 369us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909084.819225:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788909084.819526:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485824:0@lo:501: 00000100:00100000:2.0:1788909084.819572:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485952:0@lo:503: 00000100:00100000:2.0:1788909084.819612:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.820800:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019485952 00000100:00100000:3.0:1788909084.820811:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019485952 00000100:00100000:2.0:1788909084.820855:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a46e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909084.820875:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788909084.820886:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019485952:12345-0@lo:503: 00000100:00100000:3.0:1788909084.823257:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019485952:12345-0@lo:503: Request processed in 2359us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.823276:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788909084.823308:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019485952:0@lo:503: 00000100:00100000:2.0:1788909084.832297:0:8087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8087:1875807019486080:0@lo:502: 00000100:00100000:2.0:1788909084.832410:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909084.832466:0:8087:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a46d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.832675:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019486080 00000100:00100000:0.0:1788909084.832686:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019486080 00000100:00100000:0.0:1788909084.832750:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788909084.832761:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:8087:x1875807019486080:12345-0@lo:502: 00000100:00100000:0.0:1788909084.833168:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:8087:x1875807019486080:12345-0@lo:502: Request processed in 408us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.833178:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788909084.833465:0:8087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8087:1875807019486080:0@lo:502: 00000020:01000000:2.0:1788909084.833509:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788909084.833522:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909084.833525:0:8087:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788909084.833532:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788909084.833535:0:8087:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788909084.833644:0:8087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8087:1875807019486208:0@lo:502: 00000100:00100000:2.0:1788909084.833694:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909084.833771:0:8087:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a46d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909084.836325:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019486208 00000100:00100000:3.0:1788909084.836344:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019486208 00000100:00100000:3.0:1788909084.836443:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788909084.836452:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+15:8087:x1875807019486208:12345-0@lo:502: 00000100:00100000:3.0:1788909084.836754:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+15:8087:x1875807019486208:12345-0@lo:502: Request processed in 302us (3059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.836762:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788909084.836881:0:8087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8087:1875807019486208:0@lo:502: 00000020:01000000:2.0:1788909084.836923:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909084.836930:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909084.836933:0:8087:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788909084.836937:0:8087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788909084.837324:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788909084.837348:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788909084.837360:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.837386:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909084.837396:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788909084.837399:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905103af000 from 30 10000000:01000000:1.0:1788909084.837402:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788909084.837438:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.837445:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.837454:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909084.837472:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019486336:0@lo:101: 00000100:00100000:1.0:1788909084.837512:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.838352:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905180f1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.838426:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019486336 00000100:00100000:0.0:1788909084.838433:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019486336 00000100:00100000:3.0:1788909084.838496:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788909084.838508:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019486336:12345-0@lo:101: 00010000:00010000:3.0:1788909084.838523:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909084.838562:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d553b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909084.838591:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d553b expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909084.838601:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d553b expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909084.838611:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad8000, rc 0) 00000100:00100000:3.0:1788909084.838665:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019486336:12345-0@lo:101: Request processed in 160us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.838671:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788909084.838755:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019486336:0@lo:101: 00010000:00010000:1.0:1788909084.838770:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.838778:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909084.838845:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019486464:0@lo:501: 00000100:00100000:1.0:1788909084.838887:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.840279:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905180f1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788909084.840350:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019486464 00000100:00100000:2.0:1788909084.840358:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019486464 00000100:00100000:2.0:1788909084.840409:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788909084.840419:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019486464:12345-0@lo:501: 00000100:00100000:2.0:1788909084.840792:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019486464:12345-0@lo:501: Request processed in 373us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909084.840801:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788909084.840846:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019486464:0@lo:501: 00000100:00100000:1.0:1788909084.840905:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019486592:0@lo:503: 00000100:00100000:1.0:1788909084.840960:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.840986:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905180f1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.841326:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019486592 00000100:00100000:0.0:1788909084.841331:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019486592 00000100:00100000:0.0:1788909084.841412:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788909084.841422:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019486592:12345-0@lo:503: 00000100:00100000:0.0:1788909084.841601:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019486592:12345-0@lo:503: Request processed in 181us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.841609:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788909084.841857:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019486592:0@lo:503: 00000100:00100000:3.0:1788909084.842649:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8088:1875807019486720:0@lo:502: 00000100:00100000:3.0:1788909084.842702:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.847498:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905117f9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788909084.848666:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019486720 00000100:00100000:2.0:1788909084.848679:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019486720 00000100:00100000:2.0:1788909084.848745:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788909084.848755:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+16:8088:x1875807019486720:12345-0@lo:502: 00000100:00100000:2.0:1788909084.849151:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+16:8088:x1875807019486720:12345-0@lo:502: Request processed in 395us (6446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909084.849160:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788909084.849396:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8088:1875807019486720:0@lo:502: 00000100:00100000:0.0:1788909084.849479:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8088:1875807019486848:0@lo:502: 00000100:00100000:0.0:1788909084.849526:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909084.849575:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff89051ea46180 going to sleep for 11 seconds 00000100:00100000:1.0:1788909084.849649:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019486848 00000100:00100000:1.0:1788909084.849656:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019486848 00000100:00100000:1.0:1788909084.849696:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788909084.849706:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:8088:x1875807019486848:12345-0@lo:502: 00000100:00100000:1.0:1788909084.849891:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:8088:x1875807019486848:12345-0@lo:502: Request processed in 185us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909084.849898:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788909084.850029:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8088:1875807019486848:0@lo:502: 00000040:00080000:0.0:1788909084.850057:0:8088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788909084.850524:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788909084.850541:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788909084.850551:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.850563:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909084.850572:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788909084.850575:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8905103af000 from 5 10000000:01000000:1.0:1788909084.850578:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788909084.850608:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.850616:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.850634:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909084.850649:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019486976:0@lo:101: 00000100:00100000:1.0:1788909084.850686:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.850722:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905069433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.850775:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019486976 00000100:00100000:0.0:1788909084.850780:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019486976 00000100:00100000:0.0:1788909084.850833:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788909084.850840:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019486976:12345-0@lo:101: 00010000:00010000:0.0:1788909084.850851:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909084.850865:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9d000/0x733cfdd8721d5550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5549 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.850900:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9d000/0x733cfdd8721d5550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5549 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.850912:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9d000/0x733cfdd8721d5550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5549 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.850922:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d000, rc 0) 00000100:00100000:0.0:1788909084.850962:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019486976:12345-0@lo:101: Request processed in 123us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.850969:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788909084.851099:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019486976:0@lo:101: 00010000:00010000:1.0:1788909084.851146:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.851155:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909084.851207:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019487104:0@lo:256: 00000100:00100000:1.0:1788909084.851239:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.851255:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905069433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909084.851323:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019487104 00000100:00100000:2.0:1788909084.851328:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019487104 00000100:00100000:2.0:1788909084.851355:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788909084.851362:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019487104:12345-0@lo:256: 20000000:01000000:2.0:1788909084.851377:0:5817:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788909084.851395:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788909084.851398:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788909084.851483:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019487104:12345-0@lo:256: Request processed in 121us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909084.851497:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788909084.851609:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019487104:0@lo:256: 10000000:01000000:1.0:1788909084.851655:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788909084.851661:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.851668:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909084.851676:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788909084.851678:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788909084.851685:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788909084.851702:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.851710:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.851717:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909084.851729:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019487232:0@lo:101: 00000100:00100000:1.0:1788909084.851756:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.851785:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905069433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909084.851840:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019487232 00000100:00100000:2.0:1788909084.851845:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019487232 00000100:00100000:2.0:1788909084.851882:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788909084.851889:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019487232:12345-0@lo:101: 00010000:00010000:2.0:1788909084.851897:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909084.851907:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5557 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.851924:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5557 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.851933:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5557 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909084.851940:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501534600, rc 0) 00000100:00100000:2.0:1788909084.851979:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019487232:12345-0@lo:101: Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909084.851984:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788909084.852156:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019487232:0@lo:101: 00010000:00010000:1.0:1788909084.852168:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909084.852177:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909084.852221:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019487360:0@lo:501: 00000100:00100000:1.0:1788909084.852245:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.852263:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905069433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909084.852324:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019487360 00000100:00100000:3.0:1788909084.852328:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019487360 00000100:00100000:3.0:1788909084.852352:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788909084.852359:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019487360:12345-0@lo:501: 00000100:00100000:3.0:1788909084.852624:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019487360:12345-0@lo:501: Request processed in 265us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.852631:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788909084.852709:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019487360:0@lo:501: 00000100:00100000:1.0:1788909084.852735:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019487488:0@lo:503: 00000100:00100000:1.0:1788909084.852770:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.852797:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905069433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.852892:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019487488 00000100:00100000:0.0:1788909084.852898:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019487488 00000100:00100000:0.0:1788909084.852933:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788909084.852941:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019487488:12345-0@lo:503: 00000100:00100000:0.0:1788909084.853263:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019487488:12345-0@lo:503: Request processed in 323us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.853269:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788909084.853401:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019487488:0@lo:503: 00000100:00100000:1.0:1788909084.853891:0:8089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8089:1875807019487616:0@lo:502: 00000100:00100000:1.0:1788909084.853931:0:8089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.853964:0:8089:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506943600 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.854044:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019487616 00000100:00100000:0.0:1788909084.854050:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019487616 00000100:00100000:0.0:1788909084.854088:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788909084.854096:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:8089:x1875807019487616:12345-0@lo:502: 00000100:00100000:0.0:1788909084.854391:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:8089:x1875807019487616:12345-0@lo:502: Request processed in 296us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.854405:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788909084.854523:0:8089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8089:1875807019487616:0@lo:502: 00000020:01000000:2.0:1788909084.854547:0:8089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788909084.854555:0:8089:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788909084.854561:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909084.854563:0:8089:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788909084.854569:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788909084.854572:0:8089:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:2.0:1788909084.854593:0:8089:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788909084.854596:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788909084.854627:0:8089:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8905347e19b8) 00000020:00000080:2.0:1788909084.854651:0:8089:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788909084.854656:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788909084.854738:0:8089:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788909084.854745:0:8089:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788909084.854760:0:8089:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d556c 00010000:00080000:2.0:1788909084.854788:0:8089:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89052dc1c000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788909084.855097:0:8089:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788909084.855410:0:8089:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788909084.855421:0:8089:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788909084.856229:0:8089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788909084.856421:0:8089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788909084.856465:0:8089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788909084.856514:0:8089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788909084.857264:0:8090:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909084.857270:0:8090:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788909084.861204:0:8089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788909084.861223:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788909084.861264:0:8089:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788909084.861292:0:8089:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d5573 00000100:00080000:1.0:1788909084.861302:0:8089:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788909084.861307:0:8089:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89052dc1c000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788909084.861343:0:8089:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89051175fb80 x1875807019487744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788909084.861370:0:8089:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788909084.861428:0:8089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788909084.861433:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788909084.861435:0:8089:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788909084.861438:0:8089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788909084.861442:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788909084.861443:0:8089:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788909084.861446:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788909084.861448:0:8089:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788909084.861474:0:8089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8089:1875807019487872:0@lo:502: 00000100:00100000:1.0:1788909084.861554:0:8089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.861590:0:8089:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506943240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909084.861683:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019487744:0@lo:8: 00000100:00100000:3.0:1788909084.861723:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.861767:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019487872 00000100:00100000:3.0:1788909084.861774:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019487872 00000100:00100000:3.0:1788909084.861823:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788909084.861833:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:8089:x1875807019487872:12345-0@lo:502: 00000100:00100000:3.0:1788909084.862094:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:8089:x1875807019487872:12345-0@lo:502: Request processed in 262us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.862102:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788909084.862436:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019487744 00000100:00100000:1.0:1788909084.862441:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019487744 00000100:00100000:1.0:1788909084.862474:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788909084.862478:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875807019487744:12345-0@lo:8: 00010000:00080000:1.0:1788909084.862500:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:1.0:1788909084.862532:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d557a 00002000:00100000:1.0:1788909084.862546:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89052dcf9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113956 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788909084.862550:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788909084.862553:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788909084.862658:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788909084.862965:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019488128:0@lo:400: 00000100:00100000:0.0:1788909084.863010:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909084.863047:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788909084.863053:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019488256:0@lo:400: 00000100:00100000:0.0:1788909084.863079:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909084.863145:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019488128 00000100:00100000:0.0:1788909084.863149:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019488128 00000100:00100000:0.0:1788909084.863203:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788909084.863211:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019488128:12345-0@lo:400: 00000100:00100000:0.0:1788909084.863257:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019488128:12345-0@lo:400: Request processed in 47us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.863265:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788909084.863293:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788909084.863301:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1788909084.863314:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788909084.863345:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890510384000 x1875807019488128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909084.863360:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019488128:0@lo:400: 00000100:00100000:3.0:1788909084.863491:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019488000:0@lo:400: 00000100:00100000:3.0:1788909084.863520:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.863549:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788909084.863555:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019488384:0@lo:400: 00000100:00100000:3.0:1788909084.863586:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.863618:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019488000 00000100:00100000:3.0:1788909084.863622:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019488000 00000100:00100000:3.0:1788909084.863646:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019488384 00000100:00100000:3.0:1788909084.863649:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019488384 00000100:00100000:3.0:1788909084.863677:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909084.863691:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019488000:12345-0@lo:400: 00000100:00100000:3.0:1788909084.863733:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019488000:12345-0@lo:400: Request processed in 49us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.863739:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909084.863754:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788909084.863760:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019488384:12345-0@lo:400: 00000100:00100000:3.0:1788909084.863789:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019488384:12345-0@lo:400: Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.863794:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788909084.863829:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788909084.863847:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890510385f80 x1875807019488384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909084.863857:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019488384:0@lo:400: 00010000:00080000:3.0:1788909084.863883:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890510386d80 x1875807019488000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909084.863892:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019488000:0@lo:400: 00000100:00100000:2.0:1788909084.864141:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788909084.864150:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019488256 00000100:00100000:2.0:1788909084.864153:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019488256 00000100:00100000:2.0:1788909084.864181:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788909084.864188:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788909084.864195:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019488256:12345-0@lo:400: 00000100:00080000:3.0:1788909084.864259:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788909084.864516:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788909084.864566:0:6676:0:(import.c:65:import_set_state_nolock()) ffff89052dcff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788909084.864627:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1875807019487744:12345-0@lo:8: Request processed in 2147us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909084.864635:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788909084.864684:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175fb80 x1875807019487744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788909094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909084.864701:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788909084.864715:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788909084.864725:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788909084.864734:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788909084.864736:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89052dc1c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788909084.864753:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788909084.864758:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019487744:0@lo:8: 00000100:00100000:1.0:1788909084.864799:0:8089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8089:1875807019487872:0@lo:502: 00000020:01000000:1.0:1788909084.864852:0:8089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788909084.864861:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788909084.864863:0:8089:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788909084.864868:0:8089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:1.0:1788909084.865492:0:8090:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788909084.865882:0:8090:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 166939757829ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788909084.866152:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019488256:12345-0@lo:400: Request processed in 1954us (3068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909084.866164:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788909084.866419:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890510384380 x1875807019488256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909084.866437:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019488256:0@lo:400: 00000020:01000000:0.0:1788909084.868939:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788909084.868979:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788909084.868995:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.869033:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909084.869046:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788909084.869050:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff890508884d28 from 1 10000000:01000000:0.0:1788909084.869053:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788909084.869102:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.869142:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.869157:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909084.869189:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019488512:0@lo:101: 00000100:00100000:0.0:1788909084.869277:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909084.869318:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905053c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.869338:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019488512 00000100:00100000:0.0:1788909084.869345:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019488512 00000100:00100000:0.0:1788909084.869392:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788909084.869402:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019488512:12345-0@lo:101: 00010000:00010000:0.0:1788909084.869415:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909084.869428:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5581 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.869453:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5581 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.869477:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5581 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.869487:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9c800, rc 0) 00000100:00100000:0.0:1788909084.869531:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019488512:12345-0@lo:101: Request processed in 131us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909084.869539:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788909084.869600:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019488512:0@lo:101: 00010000:00010000:0.0:1788909084.869617:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.869626:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909084.869680:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019488640:0@lo:501: 00000100:00100000:0.0:1788909084.869705:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909084.869719:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905053c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.869731:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019488640 00000100:00100000:0.0:1788909084.869734:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019488640 00000100:00100000:0.0:1788909084.869757:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788909084.869763:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019488640:12345-0@lo:501: 00000100:00100000:0.0:1788909084.870019:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019488640:12345-0@lo:501: Request processed in 256us (312us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788909084.870027:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788909084.870080:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019488640:0@lo:501: 10000000:01000000:0.0:1788909084.870103:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788909084.870154:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909084.870162:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788909084.907984:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788909084.908196:0:8091:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788909084.908230:0:8091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8091:1875807019488896:0@lo:7: 00000100:00100000:3.0:1788909084.908315:0:8091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.908345:0:8091:0:(client.c:2715:ptlrpc_set_wait()) set ffff890509553f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909084.908359:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909084.908371:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019488768:0@lo:13: 00000100:00100000:3.0:1788909084.908416:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.908460:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019488896 00000100:00100000:3.0:1788909084.908467:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019488896 00000100:00100000:3.0:1788909084.908535:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788909084.908545:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8091:x1875807019488896:12345-0@lo:7: 00000100:00080000:1.0:1788909084.910180:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909084.910215:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019488768 00000100:00100000:1.0:1788909084.910224:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019488768 00000100:00100000:1.0:1788909084.910278:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788909084.910288:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875807019488768:12345-0@lo:13: 00002000:00000024:1.0:1788909084.910313:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788909084.910394:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875807019488768:12345-0@lo:13: Request processed in 107us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909084.910401:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788909084.914846:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905064d5500 x1875807019488768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909084.914886:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019488768:0@lo:13: 00002000:00080000:3.0:1788909084.920230:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788909084.920240:0:6676:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788909084.920431:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8091:x1875807019488896:12345-0@lo:7: Request processed in 11882us (12111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.920446:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788909084.920638:0:8091:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905064d4700 x1875807019488896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788909100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909084.920657:0:8091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8091:1875807019488896:0@lo:7: 00000004:00080000:1.0:1788909084.920674:0:8091:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788909084.920725:0:8091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8091:1875807019489024:0@lo:5: 00000100:00100000:1.0:1788909084.920768:0:8091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909084.920897:0:8091:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506943c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788909084.921030:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019489024 00000100:00100000:0.0:1788909084.921037:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019489024 00000100:00100000:0.0:1788909084.921150:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788909084.921161:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8091:x1875807019489024:12345-0@lo:5: 00002000:00080000:0.0:1788909084.921186:0:6673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788909084.921190:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788909084.921474:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8091:x1875807019489024:12345-0@lo:5: Request processed in 315us (705us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788909084.921481:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788909084.921584:0:8091:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175ed80 x1875807019489024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788909100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909084.921596:0:8091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8091:1875807019489024:0@lo:5: 00000004:00080000:3.0:1788909084.921608:0:8091:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788909084.921638:0:8091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8091:1875807019489152:0@lo:700: 00000100:00100000:3.0:1788909084.921683:0:8091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909084.921715:0:8091:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905053c8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788909084.921770:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019489152 00000100:00100000:2.0:1788909084.921775:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019489152 00000100:00100000:2.0:1788909084.921829:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788909084.921837:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8091:x1875807019489152:12345-0@lo:700: 00000100:00100000:2.0:1788909084.921865:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6682:1875807019489280:0@lo:700: 00000100:00100000:2.0:1788909084.921909:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909084.921929:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508877cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909084.921947:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019489280 00000100:00100000:2.0:1788909084.921951:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019489280 00000100:00100000:2.0:1788909084.921978:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788909084.921985:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6682:x1875807019489280:12345-0@lo:700: 40000000:02000000:3.0:1788909084.982822:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788909084.999965:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6682:x1875807019489280:12345-0@lo:700: Request processed in 77970us (78044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909084.999982:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788909085.009968:0:6682:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcc3480 x1875807019489280/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788909100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909085.009989:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6682:1875807019489280:0@lo:700: 40000000:02000000:2.0:1788909085.010006:0:6682:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1788909085.113431:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788909085.113786:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788909085.114446:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8091:x1875807019489152:12345-0@lo:700: Request processed in 192601us (192753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909085.114459:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788909085.114623:0:8091:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cb93800 x1875807019489152/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788909100 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909085.114635:0:8091:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788909085.114654:0:8091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8091:1875807019489152:0@lo:700: 00000004:02000040:3.0:1788909085.165906:0:8091:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788909085.175617:0:8091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8091:1875807019489408:0@lo:5: 00000100:00100000:2.0:1788909085.175716:0:8091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909085.175852:0:8091:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788909085.178347:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019489408 00000100:00100000:0.0:1788909085.178364:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019489408 00000100:00100000:0.0:1788909085.178572:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788909085.178585:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8091:x1875807019489408:12345-0@lo:5: 00002000:00080000:1.0:1788909085.191286:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788909085.191316:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788909085.194911:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8091:x1875807019489408:12345-0@lo:5: Request processed in 16319us (19184us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788909085.194929:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788909085.196432:0:8091:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcc3480 x1875807019489408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788909101 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909085.196454:0:8091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8091:1875807019489408:0@lo:5: 00000004:00080000:3.0:1788909085.196593:0:8091:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788909085.382309:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909086.406690:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909087.429822:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788909087.454994:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788909087.879234:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909087.879467:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004786816 00000100:00100000:0.0:1788909087.879480:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004786816 00000100:00100000:0.0:1788909087.879533:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:0.0:1788909087.879543:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1875807004786816:12345-192.168.204.54@tcp:250: 00010000:00080000:0.0:1788909087.879578:0:5817:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 986c0547-f072-453e-bddd-5efe6ff9e6ca@192.168.204.54@tcp t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1788909087.879611:0:5817:0:(genops.c:1385:class_connect()) connect: client 986c0547-f072-453e-bddd-5efe6ff9e6ca, cookie 0x733cfdd8721d558f 00000100:00080000:0.0:1788909087.879793:0:5817:0:(import.c:65:import_set_state_nolock()) ffff8905118ec000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788909087.879976:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+5:2346:x1875807004786816:12345-192.168.204.54@tcp:250: Request processed in 320us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909087.879986:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:3.0:1788909087.892218:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909087.892324:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004786944 00000100:00100000:0.0:1788909087.892336:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004786944 00000100:00100000:0.0:1788909087.892402:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:0.0:1788909087.892413:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+5:5577:x1875807004786944:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1788909087.892430:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909087.892449:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a44436 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909087.892580:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44436 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909087.892592:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44436 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909087.892601:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ca00, rc 0) 00000100:00100000:0.0:1788909087.892658:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+6:5577:x1875807004786944:12345-192.168.204.54@tcp:101: Request processed in 247us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909087.892666:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:0.0:1788909087.914408:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909087.914467:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004787072 00000100:00100000:0.0:1788909087.914478:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004787072 00000100:00100000:0.0:1788909087.914533:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:0.0:1788909087.914545:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+6:5577:x1875807004787072:12345-192.168.204.54@tcp:501: 00000100:00100000:0.0:1788909087.916376:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+6:5577:x1875807004787072:12345-192.168.204.54@tcp:501: Request processed in 1823us (1970us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788909087.916398:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:3.0:1788909087.923774:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909087.923826:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004787200 00000100:00100000:1.0:1788909087.923843:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004787200 00000100:00100000:1.0:1788909087.924017:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:1.0:1788909087.924031:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+6:5577:x1875807004787200:12345-192.168.204.54@tcp:101: 00010000:00010000:1.0:1788909087.924057:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909087.924096:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a4443d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909087.924162:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4443d expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909087.924178:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4443d expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909087.924190:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692600, rc 0) 00000100:00100000:1.0:1788909087.924282:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+7:5577:x1875807004787200:12345-192.168.204.54@tcp:101: Request processed in 236us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909087.924291:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1788909087.934724:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909087.934812:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004787328 00000100:00100000:3.0:1788909087.934822:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004787328 00000100:00100000:3.0:1788909087.934892:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:3.0:1788909087.934904:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+7:5577:x1875807004787328:12345-192.168.204.54@tcp:501: 00000100:00100000:3.0:1788909087.935316:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:5577:x1875807004787328:12345-192.168.204.54@tcp:501: Request processed in 413us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909087.935325:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:0.0:1788909087.942962:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909087.943019:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004787456 00000100:00100000:0.0:1788909087.943032:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004787456 00000100:00100000:0.0:1788909087.943091:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:0.0:1788909087.943103:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:5577:x1875807004787456:12345-192.168.204.54@tcp:503: 00000100:00100000:0.0:1788909087.943460:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:5577:x1875807004787456:12345-192.168.204.54@tcp:503: Request processed in 358us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909087.943470:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:0.0:1788909087.950862:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909087.951043:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004787584 00000100:00100000:3.0:1788909087.951057:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004787584 00000100:00100000:0.0:1788909087.951176:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:0.0:1788909087.951188:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:5596:x1875807004787584:12345-192.168.204.54@tcp:502: 00000100:00100000:0.0:1788909087.951697:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:5596:x1875807004787584:12345-192.168.204.54@tcp:502: Request processed in 511us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909087.951706:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:0.0:1788909087.979716:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909087.979809:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004787712 00000100:00100000:2.0:1788909087.979822:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004787712 00000100:00100000:2.0:1788909087.979887:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:2.0:1788909087.979900:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:5596:x1875807004787712:12345-192.168.204.54@tcp:502: 00000100:00100000:2.0:1788909087.980239:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:5596:x1875807004787712:12345-192.168.204.54@tcp:502: Request processed in 342us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909087.980256:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:0.0:1788909087.983549:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909087.983673:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004787840 00000100:00100000:2.0:1788909087.983684:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004787840 00000100:00100000:2.0:1788909087.983731:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:2.0:1788909087.983741:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:5577:x1875807004787840:12345-192.168.204.54@tcp:101: 00010000:00010000:2.0:1788909087.983767:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909087.983784:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501534a00/0x733cfdd8721d55a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a44467 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909087.983812:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501534a00/0x733cfdd8721d55a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44467 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909087.983823:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501534a00/0x733cfdd8721d55a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44467 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909087.983833:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501534a00, rc 0) 00000100:00100000:2.0:1788909087.983896:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5577:x1875807004787840:12345-192.168.204.54@tcp:101: Request processed in 156us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909087.983903:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:1.0:1788909087.992814:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909087.992896:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004787968 00000100:00100000:3.0:1788909087.992908:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004787968 00000100:00100000:3.0:1788909087.992975:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:3.0:1788909087.992986:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5577:x1875807004787968:12345-192.168.204.54@tcp:256: 20000000:01000000:3.0:1788909087.993019:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788909087.993046:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788909087.993050:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788909087.993053:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788909087.993056:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788909087.996927:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5577:x1875807004787968:12345-192.168.204.54@tcp:256: Request processed in 3930us (4112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909087.996946:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1788909088.008218:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909088.008592:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004788096 00000100:00100000:3.0:1788909088.008607:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004788096 00000100:00100000:3.0:1788909088.008669:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:3.0:1788909088.008680:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5577:x1875807004788096:12345-192.168.204.54@tcp:101: 00010000:00010000:3.0:1788909088.008700:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909088.008727:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a4446e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909088.008772:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4446e expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909088.008787:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4446e expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909088.008798:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9a00, rc 0) 00000100:00100000:3.0:1788909088.008893:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5577:x1875807004788096:12345-192.168.204.54@tcp:101: Request processed in 214us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909088.008902:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:0.0:1788909088.013027:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909088.013149:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004788224 00000100:00100000:3.0:1788909088.013163:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004788224 00000100:00100000:3.0:1788909088.013228:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:3.0:1788909088.013240:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5577:x1875807004788224:12345-192.168.204.54@tcp:501: 00000100:00100000:3.0:1788909088.016694:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5577:x1875807004788224:12345-192.168.204.54@tcp:501: Request processed in 3442us (3663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909088.016715:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1788909088.019796:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909088.019898:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004788352 00000100:00100000:1.0:1788909088.019913:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004788352 00000100:00100000:1.0:1788909088.019986:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:1.0:1788909088.019997:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5577:x1875807004788352:12345-192.168.204.54@tcp:503: 00000100:00100000:1.0:1788909088.020578:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5577:x1875807004788352:12345-192.168.204.54@tcp:503: Request processed in 580us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909088.020587:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:0.0:1788909088.026586:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909088.026672:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004788480 00000100:00100000:3.0:1788909088.026681:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004788480 00000100:00100000:3.0:1788909088.026738:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:3.0:1788909088.026748:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5601:x1875807004788480:12345-192.168.204.54@tcp:502: 00000100:00100000:3.0:1788909088.027034:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5601:x1875807004788480:12345-192.168.204.54@tcp:502: Request processed in 286us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909088.027042:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:3.0:1788909088.032934:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909088.033048:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004788608 00000100:00100000:1.0:1788909088.033064:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004788608 00000100:00100000:1.0:1788909088.036106:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:1.0:1788909088.036153:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5601:x1875807004788608:12345-192.168.204.54@tcp:502: 00000100:00100000:1.0:1788909088.036483:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5601:x1875807004788608:12345-192.168.204.54@tcp:502: Request processed in 340us (3563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909088.036494:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:2.0:1788909088.042580:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909088.042677:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004788736 00000100:00100000:3.0:1788909088.042690:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004788736 00000100:00100000:3.0:1788909088.042764:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788909088.042774:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1875807004788736:12345-192.168.204.54@tcp:38: 00010000:00080000:3.0:1788909088.042810:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1788909088.042880:0:5823:0:(genops.c:1385:class_connect()) connect: client 9a693284-9812-4b47-95bb-9bc33a7c4ef4, cookie 0x733cfdd8721d55b2 00000004:00100000:3.0:1788909088.042930:0:5823:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788909088.042938:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788909088.072238:0:5823:0:(import.c:65:import_set_state_nolock()) ffff890537887800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788909088.073459:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2346:x1875807004788736:12345-192.168.204.54@tcp:38: Request processed in 30678us (30887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909088.073474:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00010000:00010000:2.0:1788909088.453563:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909088.901769:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788909088.901804:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019489536:0@lo:13: 00000100:00100000:2.0:1788909088.901908:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909088.902199:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019489536 00000100:00100000:1.0:1788909088.902207:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019489536 00000100:00100000:1.0:1788909088.902297:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788909088.902310:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019489536:12345-0@lo:13: 00002000:00000024:1.0:1788909088.902352:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909088.902419:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019489536:12345-0@lo:13: Request processed in 112us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909088.902438:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788909088.902531:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175c700 x1875807019489536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909088.902559:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019489536:0@lo:13: 00000100:00080000:3.0:1788909088.902746:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909089.080334:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909089.080432:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004788992 00000100:00100000:3.0:1788909089.080443:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004788992 00000100:00100000:3.0:1788909089.080536:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00080000:1.0:1788909089.080542:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909089.080549:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5577:x1875807004788992:12345-192.168.204.54@tcp:41: 00000004:00000024:3.0:1788909089.080613:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788909089.080712:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5577:x1875807004788992:12345-192.168.204.54@tcp:41: Request processed in 166us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909089.080721:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788909089.087754:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909089.087802:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909089.087878:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004789120 00000100:00100000:2.0:1788909089.087879:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004788864 00000100:00100000:2.0:1788909089.087893:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004788864 00000100:00100000:3.0:1788909089.087894:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004789120 00000100:00100000:2.0:1788909089.088034:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788909089.088045:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:0:x1875807004788864:12345-192.168.204.54@tcp:41: 00000004:00000024:2.0:1788909089.088101:0:7640:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788909089.088238:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:0:x1875807004788864:12345-192.168.204.54@tcp:41: Request processed in 195us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909089.088246:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788909089.088270:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788909089.088278:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5577:x1875807004789120:12345-192.168.204.54@tcp:40: 00000100:00100000:2.0:1788909089.088310:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5577:x1875807004789120:12345-192.168.204.54@tcp:40: Request processed in 33us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909089.088317:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788909089.112013:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909089.112065:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909089.112080:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909089.112132:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909089.112174:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004789248 00000100:00100000:2.0:1788909089.112183:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004789248 00000100:00100000:2.0:1788909089.112212:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004789376 00000100:00100000:2.0:1788909089.112214:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004789376 00000100:00100000:2.0:1788909089.112231:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788909089.112239:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875807004789248:12345-192.168.204.54@tcp:8: 00010000:00080000:2.0:1788909089.112269:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1788909089.112299:0:6673:0:(genops.c:1385:class_connect()) connect: client 9a693284-9812-4b47-95bb-9bc33a7c4ef4, cookie 0x733cfdd8721d55b9 00002000:00100000:2.0:1788909089.112311:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9a693284-9812-4b47-95bb-9bc33a7c4ef4/ffff89052dc1e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788909089.112322:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788909089.112523:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788909089.112529:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875807004789376:12345-192.168.204.54@tcp:8: 00010000:00080000:1.0:1788909089.112544:0:8092:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1788909089.112561:0:8092:0:(genops.c:1385:class_connect()) connect: client 9a693284-9812-4b47-95bb-9bc33a7c4ef4, cookie 0x733cfdd8721d55c0 00002000:00100000:1.0:1788909089.112566:0:8092:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9a693284-9812-4b47-95bb-9bc33a7c4ef4/ffff890537b21800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788909089.112585:0:8092:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788909089.112948:0:8092:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788909089.112979:0:8092:0:(import.c:65:import_set_state_nolock()) ffff890537b23800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788909089.113045:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2346:x1875807004789376:12345-192.168.204.54@tcp:8: Request processed in 513us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909089.113053:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788909089.113222:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004789632 00000100:00100000:1.0:1788909089.113227:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004789632 00000100:00100000:1.0:1788909089.113256:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:1.0:1788909089.113262:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004789632:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788909089.113309:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004789632:12345-192.168.204.54@tcp:400: Request processed in 47us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909089.113314:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:3.0:1788909089.114921:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004789504 00000100:00100000:3.0:1788909089.114944:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004789504 00000100:00100000:3.0:1788909089.115047:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788909089.115056:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5577:x1875807004789504:12345-192.168.204.54@tcp:33: 00002000:00080000:2.0:1788909089.117768:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788909089.117829:0:6673:0:(import.c:65:import_set_state_nolock()) ffff89052dc1d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788909089.121040:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2346:x1875807004789248:12345-192.168.204.54@tcp:8: Request processed in 8783us (8955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909089.121061:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000004:00080000:3.0:1788909089.144976:0:5825:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29810us 00000004:00200000:3.0:1788909089.156662:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788909089.156872:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5577:x1875807004789504:12345-192.168.204.54@tcp:33: Request processed in 41810us (44862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909089.156883:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788909089.402243:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909089.402430:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004789760 00000100:00100000:0.0:1788909089.402441:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004789760 00000100:00100000:0.0:1788909089.402533:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788909089.402545:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5618:x1875807004789760:12345-192.168.204.54@tcp:101: 00010000:00010000:0.0:1788909089.402567:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909089.402593:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d55c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44498 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909089.402678:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d800/0x733cfdd8721d55ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909089.402697:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d800/0x733cfdd8721d55ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909089.402716:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d800/0x733cfdd8721d55ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909089.402994:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788909089.402999:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909089.403079:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d800/0x733cfdd8721d55ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909089.403151:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d55c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44498 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909089.403178:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d800/0x733cfdd8721d55ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44498 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909089.403187:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510bdee00) 00010000:00010000:0.0:1788909089.403202:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788909089.403206:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d800, rc 0) 00000100:00100000:0.0:1788909089.404031:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:5618:x1875807004789760:12345-192.168.204.54@tcp:101: Request processed in 1484us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909089.404049:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:1.0:1788909089.477411:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909089.927737:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019489664:0@lo:400: 00000100:00100000:0.0:1788909089.927827:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909089.927947:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019489664 00000100:00100000:2.0:1788909089.927956:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019489664 00000100:00100000:2.0:1788909089.928025:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788909089.928034:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019489664:12345-0@lo:400: 00000100:00100000:0.0:1788909089.930806:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019490176:0@lo:13: 00000100:00100000:1.0:1788909089.935452:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019490048:0@lo:400: 00000100:00100000:2.0:1788909089.935921:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019489664:12345-0@lo:400: Request processed in 7882us (8087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909089.935937:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788909089.936034:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019489792:0@lo:400: 00000100:00100000:2.0:1788909089.936099:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909089.936150:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019490304:0@lo:400: 00000100:00100000:2.0:1788909089.936173:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909089.936205:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788909089.936213:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019489920:0@lo:400: 00000100:00100000:2.0:1788909089.936238:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909089.936257:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019490432:0@lo:400: 00000100:00100000:2.0:1788909089.936282:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909089.936350:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019489792 00000100:00100000:2.0:1788909089.936362:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019489792 00000100:00100000:2.0:1788909089.936430:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019490304 00000100:00100000:2.0:1788909089.936434:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019490304 00000100:00100000:2.0:1788909089.936460:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019489920 00000100:00100000:2.0:1788909089.936463:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019489920 00000100:00100000:2.0:1788909089.937646:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788909089.937659:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019489792:12345-0@lo:400: 00000100:00100000:2.0:1788909089.937812:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019489792:12345-0@lo:400: Request processed in 155us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909089.937820:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788909089.937848:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788909089.937856:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019490304:12345-0@lo:400: 00000100:00100000:2.0:1788909089.938024:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019490304:12345-0@lo:400: Request processed in 169us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909089.938032:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788909089.938048:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788909089.938055:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019489920:12345-0@lo:400: 00000100:00100000:2.0:1788909089.938088:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019489920:12345-0@lo:400: Request processed in 34us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909089.938094:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788909089.938149:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019490432 00000100:00100000:2.0:1788909089.938158:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019490432 00000100:00100000:2.0:1788909089.938204:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788909089.938212:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019490432:12345-0@lo:400: 00000100:00100000:2.0:1788909089.938248:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019490432:12345-0@lo:400: Request processed in 37us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909089.938254:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788909089.938271:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788909089.938277:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909089.938550:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019489920:0@lo:400: 00010000:00080000:2.0:1788909089.938571:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175f100 x1875807019490432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909089.938582:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788909089.938677:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019490432:0@lo:400: 00000100:00100000:2.0:1788909089.938694:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019489792:0@lo:400: 00000100:00100000:2.0:1788909089.938704:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019490304:0@lo:400: 00000100:00100000:1.0:1788909089.941643:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909089.941725:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909089.941835:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019490048 00000100:00100000:3.0:1788909089.941850:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019490048 00000100:00100000:2.0:1788909089.941852:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019490176 00000100:00100000:2.0:1788909089.941857:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019490176 00000100:00100000:3.0:1788909089.941926:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788909089.941955:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019490048:12345-0@lo:400: 00000100:00100000:2.0:1788909089.942048:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788909089.942058:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019490176:12345-0@lo:13: 00002000:00000024:2.0:1788909089.942080:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1788909089.942174:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175ea00 x1875807019490048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909089.942191:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019490048:0@lo:400: 00000100:00100000:0.0:1788909089.942191:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019489664:0@lo:400: 00000100:00100000:3.0:1788909089.942322:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019490048:12345-0@lo:400: Request processed in 371us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909089.942330:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788909089.942425:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019490176:12345-0@lo:13: Request processed in 370us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909089.942432:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788909089.942520:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cb93800 x1875807019490176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909089.942538:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019490176:0@lo:13: 00010000:00010000:2.0:1788909090.503012:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909091.362428:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909091.362603:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004789888 00000100:00100000:0.0:1788909091.362617:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004789888 00000100:00100000:0.0:1788909091.362720:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788909091.362733:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:5670:x1875807004789888:12345-192.168.204.54@tcp:41: 00000004:00000024:0.0:1788909091.362795:0:5824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788909091.362881:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:5670:x1875807004789888:12345-192.168.204.54@tcp:41: Request processed in 152us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909091.362889:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:2.0:1788909091.363490:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909091.366946:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909091.367174:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004790016 00000100:00100000:0.0:1788909091.367190:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004790016 00000100:00100000:0.0:1788909091.367311:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788909091.367326:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5670:x1875807004790016:12345-192.168.204.54@tcp:13: 00002000:00000024:0.0:1788909091.367434:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788909091.367665:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5670:x1875807004790016:12345-192.168.204.54@tcp:13: Request processed in 342us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909091.367674:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00080000:2.0:1788909091.368022:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788909091.370604:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909091.370972:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004790144 00000100:00100000:0.0:1788909091.370984:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004790144 00000100:00100000:0.0:1788909091.371088:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788909091.371102:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5670:x1875807004790144:12345-192.168.204.54@tcp:13: 00002000:00000024:0.0:1788909091.371190:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788909091.371309:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788909091.372254:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:5670:x1875807004790144:12345-192.168.204.54@tcp:13: Request processed in 1144us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909091.372270:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:2.0:1788909091.525928:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788909092.044924:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00010000:00010000:1.0:1788909092.550295:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788909093.564013:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000001:00100000:3.0:1788909093.573751:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00010000:00010000:2.0:1788909093.580219:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909094.022701:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788909094.022741:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019490560:0@lo:13: 00000100:00100000:2.0:1788909094.022836:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909094.023102:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019490560 00000100:00100000:3.0:1788909094.023152:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019490560 00000100:00100000:3.0:1788909094.023246:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788909094.023259:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019490560:12345-0@lo:13: 00002000:00000024:3.0:1788909094.023311:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909094.023365:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019490560:12345-0@lo:13: Request processed in 110us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909094.023372:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788909094.023422:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175ea00 x1875807019490560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909094.023449:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019490560:0@lo:13: 00000100:00080000:2.0:1788909094.023599:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788909094.041953:0:8296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788909094.489535:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909094.489623:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909094.489683:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909094.489730:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909094.490061:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004790656 00000100:00100000:1.0:1788909094.490079:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004790656 00000100:00100000:1.0:1788909094.490236:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788909094.490262:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004790656:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788909094.490406:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004790656:12345-192.168.204.54@tcp:400: Request processed in 148us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909094.490415:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00080000:1.0:1788909094.490482:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788909094.491415:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004790272 00000100:00100000:3.0:1788909094.491425:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004790272 00000100:00100000:3.0:1788909094.491484:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:3.0:1788909094.491494:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004790272:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1788909094.491572:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004790272:12345-192.168.204.54@tcp:400: Request processed in 80us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909094.491580:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:0.0:1788909094.492507:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004790400 00000100:00100000:0.0:1788909094.492519:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004790400 00000100:00100000:0.0:1788909094.492607:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788909094.492617:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004790400:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1788909094.492695:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004790400:12345-192.168.204.54@tcp:400: Request processed in 80us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909094.492703:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00080000:3.0:1788909094.493696:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909094.493918:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004790528 00000100:00100000:1.0:1788909094.493931:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004790528 00000100:00100000:1.0:1788909094.494521:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788909094.494539:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004790528:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788909094.495465:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004790528:12345-192.168.204.54@tcp:400: Request processed in 921us (5723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909094.495507:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00080000:3.0:1788909094.495745:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788909094.600552:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909095.045960:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019490816:0@lo:400: 00000100:00100000:2.0:1788909095.046069:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909095.046170:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019491328:0@lo:400: 00000100:00100000:2.0:1788909095.046202:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909095.046239:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909095.046246:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019490944:0@lo:400: 00000100:00100000:2.0:1788909095.046271:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909095.046422:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019490688:0@lo:400: 00000100:00100000:0.0:1788909095.046469:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909095.046501:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019491200:0@lo:400: 00000100:00100000:0.0:1788909095.046534:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909095.046569:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788909095.046576:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019491072:0@lo:400: 00000100:00100000:0.0:1788909095.046602:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909095.046655:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019490816 00000100:00100000:0.0:1788909095.046667:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019490816 00000100:00100000:0.0:1788909095.046741:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019490944 00000100:00100000:0.0:1788909095.046745:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019490944 00000100:00100000:0.0:1788909095.046777:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019491200 00000100:00100000:0.0:1788909095.046780:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019491200 00000100:00100000:0.0:1788909095.046802:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788909095.046812:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019490816:12345-0@lo:400: 00000100:00100000:0.0:1788909095.046886:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019490816:12345-0@lo:400: Request processed in 74us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909095.046903:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788909095.046934:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788909095.046942:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019490944:12345-0@lo:400: 00000100:00100000:0.0:1788909095.046971:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019490944:12345-0@lo:400: Request processed in 31us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909095.046978:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788909095.046990:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788909095.046996:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019491200:12345-0@lo:400: 00000100:00100000:0.0:1788909095.047028:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019491200:12345-0@lo:400: Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909095.047034:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788909095.047059:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019491328 00000100:00100000:0.0:1788909095.047064:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019491328 00000100:00100000:0.0:1788909095.047100:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019491072 00000100:00100000:0.0:1788909095.047103:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019491072 00000100:00100000:0.0:1788909095.047149:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788909095.047164:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019491328:12345-0@lo:400: 00000100:00100000:0.0:1788909095.047201:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019491328:12345-0@lo:400: Request processed in 39us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909095.047207:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788909095.047220:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788909095.047227:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019491072:12345-0@lo:400: 00000100:00100000:0.0:1788909095.047255:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019491072:12345-0@lo:400: Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909095.047261:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788909095.047285:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788909095.047291:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788909095.047332:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cc39500 x1875807019491072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909095.047350:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019491072:0@lo:400: 00000100:00100000:0.0:1788909095.047364:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019491200:0@lo:400: 00000100:00100000:0.0:1788909095.047414:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019490944:0@lo:400: 00000100:00100000:0.0:1788909095.047425:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019490816:0@lo:400: 00010000:00080000:0.0:1788909095.047436:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cc3bb80 x1875807019491328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909095.047447:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019491328:0@lo:400: 00000100:00100000:2.0:1788909095.047698:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019490688 00000100:00100000:2.0:1788909095.047704:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019490688 00000100:00100000:2.0:1788909095.047756:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788909095.047765:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019490688:12345-0@lo:400: 00000100:00100000:2.0:1788909095.047821:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019490688:12345-0@lo:400: Request processed in 57us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909095.047828:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788909095.048967:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019490688:0@lo:400: 00000100:00100000:2.0:1788909095.050884:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019491456:0@lo:13: 00000100:00100000:2.0:1788909095.051008:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909095.051354:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019491456 00000100:00100000:0.0:1788909095.051367:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019491456 00000100:00100000:0.0:1788909095.051444:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788909095.051479:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019491456:12345-0@lo:13: 00002000:00000024:0.0:1788909095.051542:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788909095.059056:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019491456:12345-0@lo:13: Request processed in 7557us (8025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909095.059086:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788909095.066533:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cb91180 x1875807019491456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909095.066574:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019491456:0@lo:13: 00010000:00010000:0.0:1788909095.621555:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909096.651221:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909097.670390:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788909098.371647:0:8445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed5dadee0 20000000:00000080:2.0:1788909098.371679:0:8445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890537ef8000 uarg=0000000000000000 20000000:01000000:2.0:1788909098.371734:0:8445:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788909098.371737:0:8445:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788909098.371740:0:8445:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788909098.371747:0:8445:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788909098.371764:0:8445:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788909098.371782:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788909098.371785:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788909098.372071:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788909098.372075:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788909098.374608:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788909098.375876:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788909098.375934:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788909098.375996:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788909098.376014:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788909098.376017:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788909098.377080:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788909098.377918:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788909098.377991:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788909098.378029:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788909098.378046:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788909098.378049:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788909098.381729:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788909098.382471:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788909098.382564:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788909098.382605:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788909098.382622:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788909098.382626:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788909098.383797:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788909098.384465:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788909098.384672:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788909098.384718:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1788909098.384744:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788909098.384777:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384806:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d54cb expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384817:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d54f5 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384825:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d551f expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384832:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d552d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384839:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d553b expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384848:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5557 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384856:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5581 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384883:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44436 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384892:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4443d expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384901:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384965:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4443d expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.384991:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4443d expref: 9 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.385013:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019491584:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909098.385186:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44436 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.385195:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44436 expref: 9 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.385204:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019491712:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909098.386411:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d5581 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.386431:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d5581 expref: 18 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.386463:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019491840:0@lo:104: 00000100:00100000:3.0:1788909098.386550:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788909098.386620:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d5557 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.386629:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d5557 expref: 18 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.386637:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019491968:0@lo:104: 00000100:00100000:3.0:1788909098.386661:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788909098.386695:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d553b expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.386704:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d553b expref: 18 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.386712:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb92680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492096:0@lo:104: 00010000:00010000:3.0:1788909098.386737:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d552d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.386746:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d552d expref: 18 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.386753:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492224:0@lo:104: 00010000:00010000:3.0:1788909098.386778:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d551f expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.386786:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d551f expref: 18 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.386802:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492352:0@lo:104: 00010000:00010000:3.0:1788909098.386831:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d54f5 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.386839:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d54f5 expref: 18 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.386847:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492480:0@lo:104: 00010000:00010000:3.0:1788909098.386872:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d54cb expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.386881:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d54cb expref: 18 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.386888:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb92d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492608:0@lo:104: 00000100:00100000:3.0:1788909098.386909:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788909098.387178:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788909098.387201:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909098.387224:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909098.387235:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909098.387249:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909098.387261:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909098.387272:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019491840 00000100:00100000:1.0:1788909098.387282:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019491840 00000100:00100000:1.0:1788909098.387342:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019491968 00000100:00100000:1.0:1788909098.387346:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019491968 00000100:00100000:1.0:1788909098.387358:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019492096 00000100:00100000:1.0:1788909098.387360:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019492096 00000100:00100000:1.0:1788909098.387368:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019492224 00000100:00100000:1.0:1788909098.387370:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019492224 00000100:00100000:1.0:1788909098.387378:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019492352 00000100:00100000:1.0:1788909098.387380:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019492352 00000100:00100000:1.0:1788909098.387388:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019492480 00000100:00100000:1.0:1788909098.387390:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019492480 00000100:00100000:1.0:1788909098.387398:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019492608 00000100:00100000:1.0:1788909098.387400:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019492608 00000100:00100000:1.0:1788909098.387414:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788909098.387426:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+9:8445:x1875807019491840:12345-0@lo:104: 00010000:00010000:1.0:1788909098.387443:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909098.387593:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788909098.387606:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dc4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+9:8445:x1875807019491968:12345-0@lo:104: 00010000:00010000:2.0:1788909098.387615:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.387844:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019491840:0@lo:104: 00000100:00100000:3.0:1788909098.387855:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019491968:0@lo:104: 00000100:00100000:3.0:1788909098.388229:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019491584:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788909098.388592:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788909098.388602:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+9:8445:x1875807019491840:12345-0@lo:104: Request processed in 1177us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909098.388629:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788909098.388665:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788909098.388674:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+8:8445:x1875807019492096:12345-0@lo:104: 00010000:00010000:1.0:1788909098.388685:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.388787:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb92680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492096:0@lo:104: 00010000:00010000:2.0:1788909098.388885:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788909098.388893:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dc4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+8:8445:x1875807019491968:12345-0@lo:104: Request processed in 1292us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909098.388900:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788909098.388948:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788909098.388956:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+7:8445:x1875807019492224:12345-0@lo:104: 00010000:00010000:2.0:1788909098.388964:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.389004:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788909098.389016:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+7:8445:x1875807019492224:12345-0@lo:104: Request processed in 63us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909098.389023:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788909098.389037:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788909098.389045:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+6:8445:x1875807019492352:12345-0@lo:104: 00010000:00010000:2.0:1788909098.389052:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.389083:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788909098.389088:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+6:8445:x1875807019492352:12345-0@lo:104: Request processed in 44us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909098.389093:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788909098.389106:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788909098.389134:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+5:8445:x1875807019492480:12345-0@lo:104: 00010000:00010000:2.0:1788909098.389143:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.389173:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788909098.389178:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+5:8445:x1875807019492480:12345-0@lo:104: Request processed in 46us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909098.389183:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788909098.389196:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788909098.389203:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+4:8445:x1875807019492608:12345-0@lo:104: 00010000:00010000:2.0:1788909098.389213:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.389238:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788909098.389257:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:de4f34ee-762f-480d-9428-329e99488659+4:8445:x1875807019492608:12345-0@lo:104: Request processed in 54us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909098.389263:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788909098.389287:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788909098.389294:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.389304:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c400 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909098.389309:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.389320:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909098.389328:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909098.389335:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788909098.389386:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788909098.389393:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.389400:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693600 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:3.0:1788909098.389403:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.389418:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788909098.389423:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909098.389428:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788909098.389582:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788909098.389694:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788909098.389702:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:8445:x1875807019492096:12345-0@lo:104: Request processed in 1030us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909098.389709:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788909098.389789:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.389797:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909098.389946:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788909098.389956:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.389964:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692400 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909098.389968:0:6689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.389976:0:6689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909098.389983:0:6689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909098.389988:0:6689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788909098.390002:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.390010:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909098.390015:0:6689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390023:0:6689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909098.390046:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909098.390052:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019492736:0@lo:103: 00010000:00010000:0.0:1788909098.390087:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501692400/0x733cfdd8721d553b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5542 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390129:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788909098.390133:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909098.390142:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788909098.390146:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501534200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909098.390154:0:6689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390162:0:6689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909098.390170:0:6689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909098.390175:0:6689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788909098.390205:0:6689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390225:0:6689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909098.390234:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390236:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390251:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d551f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5526 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390264:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788909098.390288:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.390311:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890504d9c400/0x733cfdd8721d5581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5588 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390314:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692000 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909098.390323:0:6689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.390329:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909098.390334:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390336:0:6689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909098.390349:0:6689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.390366:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9000 already unused, calling callback (ffffffffc1b52c20) 10000000:01000000:0.0:1788909098.390368:0:6689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1788909098.390371:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.390380:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909098.390387:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909098.390393:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788909098.390396:0:6689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.390405:0:6689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909098.390416:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.390424:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909098.390429:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.390436:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d54cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54d2 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.390447:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909098.390449:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909098.390451:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909098.390729:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.390739:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501693600/0x733cfdd8721d5557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d555e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.390750:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909098.390752:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909098.390754:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909098.390769:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019492864:0@lo:103: 00000100:00100000:3.0:1788909098.390806:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909098.390835:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019493376:0@lo:103: 00000100:00100000:3.0:1788909098.390858:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909098.390882:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788909098.390888:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019493248:0@lo:103: 00000100:00100000:3.0:1788909098.390908:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909098.390934:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019492736 00000100:00100000:3.0:1788909098.390951:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019492736 00010000:00010000:3.0:1788909098.390983:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5581 expref: 19 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.391007:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019492864 00000100:00100000:3.0:1788909098.391010:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019492864 00010000:00010000:3.0:1788909098.391021:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5557 expref: 20 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.391032:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019493376 00000100:00100000:3.0:1788909098.391034:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019493376 00010000:00010000:3.0:1788909098.391046:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d54cb expref: 21 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.391055:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019493248 00000100:00100000:3.0:1788909098.391057:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019493248 00010000:00010000:3.0:1788909098.391069:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d54f5 expref: 22 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.391083:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788909098.391092:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+22:3283:x1875807019492736:12345-0@lo:103: 00010000:00010000:3.0:1788909098.391134:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788909098.391350:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909098.391371:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019493120:0@lo:103: 00000100:00100000:2.0:1788909098.391400:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909098.391419:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788909098.391425:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019492992:0@lo:103: 00000100:00100000:2.0:1788909098.391457:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788909098.391880:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909098.391886:0:5808:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1788909098.391896:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501692000/0x733cfdd8721d54f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54fc expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909098.391903:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788909098.391915:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909098.391919:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909098.391922:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909098.392280:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5581 expref: 22 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.392308:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d5581 expref: 22 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.392330:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9c800/0x733cfdd8721d5588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d5581 expref: 22 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.392349:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909098.392427:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+21:3283:x1875807019492736:12345-0@lo:103: Request processed in 1335us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909098.392437:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788909098.392460:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004790784 00000100:00100000:3.0:1788909098.392466:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004790784 00000100:00100000:1.0:1788909098.392729:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019492736:0@lo:103: 00010000:00010000:3.0:1788909098.392812:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4443d expref: 10 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.392831:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019493120 00000100:00100000:3.0:1788909098.392834:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019493120 00010000:00010000:3.0:1788909098.392845:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d551f expref: 21 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.392855:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019492992 00000100:00100000:3.0:1788909098.392858:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019492992 00010000:00010000:3.0:1788909098.392869:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d553b expref: 22 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.392882:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788909098.392891:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+22:3284:x1875807019492864:12345-0@lo:103: 00010000:00010000:3.0:1788909098.392908:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909098.392913:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5557 expref: 22 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.392922:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d5557 expref: 22 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.392932:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501534600/0x733cfdd8721d555e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d5557 expref: 22 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.392942:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909098.392998:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+21:3284:x1875807019492864:12345-0@lo:103: Request processed in 107us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909098.393006:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788909098.393021:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788909098.393028:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+20:3284:x1875807019493376:12345-0@lo:103: 00010000:00010000:3.0:1788909098.393037:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909098.393043:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d54cb expref: 20 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.393053:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d54cb expref: 20 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.393065:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909098.393089:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+20:3284:x1875807019493376:12345-0@lo:103: Request processed in 62us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909098.393096:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788909098.393143:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909098.393151:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019493248:12345-0@lo:103: 00010000:00010000:3.0:1788909098.393161:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909098.393165:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d54f5 expref: 19 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.393175:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d54f5 expref: 19 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.393186:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909098.393208:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019493248:12345-0@lo:103: Request processed in 58us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909098.393215:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909098.393236:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1788909098.393243:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2350:x1875807004790784:12345-192.168.204.54@tcp:103: 00010000:00010000:3.0:1788909098.393259:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909098.393264:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4443d expref: 10 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.393276:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4443d expref: 10 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.393288:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501692600/0x733cfdd8721d559d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4443d expref: 10 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909098.393394:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019493248:0@lo:103: 00000100:00100000:1.0:1788909098.393404:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019492864:0@lo:103: 00000100:00100000:1.0:1788909098.393412:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019493376:0@lo:103: 00010000:00010000:3.0:1788909098.393825:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909098.393895:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:2350:x1875807004790784:12345-192.168.204.54@tcp:103: Request processed in 651us (2547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909098.393904:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1788909098.393920:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788909098.393927:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+18:3286:x1875807019493120:12345-0@lo:103: 00010000:00010000:3.0:1788909098.393938:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909098.393943:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d551f expref: 18 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.393952:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d551f expref: 18 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.393964:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909098.394002:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+18:3286:x1875807019493120:12345-0@lo:103: Request processed in 76us (2601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909098.394008:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788909098.394030:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788909098.394037:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905103e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+17:3286:x1875807019492992:12345-0@lo:103: 00010000:00010000:3.0:1788909098.394046:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909098.394052:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d553b expref: 17 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.394060:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d553b expref: 17 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.394070:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad8000/0x733cfdd8721d5542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d553b expref: 17 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.394081:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909098.394104:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905103e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+16:3286:x1875807019492992:12345-0@lo:103: Request processed in 68us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909098.394136:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788909098.394273:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909098.394738:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019492992:0@lo:103: 00000100:00100000:3.0:1788909098.394750:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019493120:0@lo:103: 00000100:00100000:3.0:1788909098.394781:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004790912 00000100:00100000:3.0:1788909098.394787:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004790912 00010000:00010000:3.0:1788909098.394813:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44436 expref: 9 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909098.395046:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1788909098.395056:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:2350:x1875807004790912:12345-192.168.204.54@tcp:103: 00010000:00010000:3.0:1788909098.395066:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909098.395072:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44436 expref: 9 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.395095:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44436 expref: 9 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909098.395130:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909098.395171:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:2350:x1875807004790912:12345-192.168.204.54@tcp:103: Request processed in 117us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909098.395178:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:1.0:1788909098.396239:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9ca00/0x733cfdd8721d5596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44436 expref: 8 pid: 5816 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909098.396353:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019491712:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909098.396372:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492224:0@lo:104: 00010000:00010000:1.0:1788909098.396384:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad9600/0x733cfdd8721d5526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d551f expref: 15 pid: 5817 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909098.396409:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492352:0@lo:104: 00010000:00010000:1.0:1788909098.396423:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d54fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d54f5 expref: 14 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909098.396432:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492480:0@lo:104: 00010000:00010000:1.0:1788909098.396443:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501692c00/0x733cfdd8721d54d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d54cb expref: 13 pid: 5815 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909098.396451:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb92d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875807019492608:0@lo:104: 00010000:00010000:1.0:1788909098.396631:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.398666:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909098.398673:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909098.398676:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909098.398712:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.398729:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535400 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909098.398754:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.398766:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909098.398774:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909098.398781:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788909098.398869:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.398877:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909098.398915:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.398923:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501535400/0x733cfdd8721d552d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5534 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.398944:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909098.398946:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909098.398947:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909098.398987:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788909098.399019:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019493504:0@lo:103: 00000100:00100000:3.0:1788909098.399180:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909098.399831:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019493504 00000100:00100000:0.0:1788909098.399846:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019493504 00010000:00010000:0.0:1788909098.399902:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d552d expref: 13 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909098.399951:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788909098.399963:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+13:3286:x1875807019493504:12345-0@lo:103: 00010000:00010000:0.0:1788909098.399984:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909098.400006:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d552d expref: 13 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400020:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d552d expref: 13 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400039:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9d600/0x733cfdd8721d5534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d552d expref: 13 pid: 5816 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400056:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400064:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400083:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400092:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400099:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400106:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400135:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9e00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909098.400141:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400150:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400611:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909098.400626:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909098.400708:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+12:3286:x1875807019493504:12345-0@lo:103: Request processed in 745us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909098.400717:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788909098.400865:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019493504:0@lo:103: 00010000:00010000:1.0:1788909098.400943:0:8445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909098.400951:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909098.400958:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d55d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909098.695190:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909099.142263:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909099.147564:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019493632:0@lo:13: 00000100:00100000:2.0:1788909099.147652:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.147842:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019493632 00000100:00100000:3.0:1788909099.147851:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019493632 00000100:00100000:3.0:1788909099.147918:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788909099.147931:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019493632:12345-0@lo:13: 00002000:00000024:3.0:1788909099.147972:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909099.148029:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019493632:12345-0@lo:13: Request processed in 102us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909099.148037:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788909099.148191:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175df80 x1875807019493632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909099.148214:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019493632:0@lo:13: 00000100:00080000:0.0:1788909099.148525:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909099.610877:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909099.610936:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909099.610973:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004791296 00000100:00100000:0.0:1788909099.610984:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004791296 00000100:00100000:1.0:1788909099.610989:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909099.611034:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909099.611058:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004791424 00000100:00100000:1.0:1788909099.611063:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004791424 00000100:00100000:1.0:1788909099.611144:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788909099.611164:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004791424:12345-192.168.204.54@tcp:400: 00000100:00100000:0.0:1788909099.611201:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1788909099.611214:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004791296:12345-192.168.204.54@tcp:400: 00000100:00100000:2.0:1788909099.611367:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004791040 00000100:00100000:2.0:1788909099.611372:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004791040 00000100:00100000:2.0:1788909099.611406:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1788909099.611411:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004791168 00000100:00100000:3.0:1788909099.611417:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004791168 00000100:00100000:2.0:1788909099.611540:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:2348:x1875807004791040:12345-192.168.204.54@tcp:400: 00000100:00100000:3.0:1788909099.611556:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1788909099.611566:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2348:x1875807004791168:12345-192.168.204.54@tcp:400: 00000100:00100000:1.0:1788909099.611599:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004791424:12345-192.168.204.54@tcp:400: Request processed in 437us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909099.611608:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788909099.611619:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004791296:12345-192.168.204.54@tcp:400: Request processed in 407us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909099.611628:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:1.0:1788909099.611657:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788909099.611663:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788909099.611665:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788909099.615993:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:2348:x1875807004791040:12345-192.168.204.54@tcp:400: Request processed in 4512us (5062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.616009:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1788909099.618847:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2348:x1875807004791168:12345-192.168.204.54@tcp:400: Request processed in 7266us (7843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909099.618864:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00010000:00010000:3.0:1788909099.717382:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788909099.781284:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788909099.781296:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905375be800 from 39 10000000:01000000:2.0:1788909099.781303:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788909099.781376:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.781389:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.781403:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909099.781631:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019493760:0@lo:101: 00000100:00100000:2.0:1788909099.781714:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909099.781899:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019493760 00000100:00100000:0.0:1788909099.781908:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019493760 00000100:00100000:0.0:1788909099.781975:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788909099.781985:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+12:5820:x1875807019493760:12345-0@lo:101: 00010000:00010000:0.0:1788909099.782003:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909099.782017:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9de00/0x733cfdd8721d55e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d55dc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909099.782548:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8acc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788909099.783043:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9de00/0x733cfdd8721d55e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d55dc expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909099.783059:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9de00/0x733cfdd8721d55e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d55dc expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909099.783082:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9de00, rc 0) 00000100:00100000:0.0:1788909099.783180:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019493760:12345-0@lo:101: Request processed in 1196us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909099.783189:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788909099.783648:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019493760:0@lo:101: 00010000:00010000:2.0:1788909099.783665:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.783674:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909099.783743:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019493888:0@lo:501: 00000100:00100000:2.0:1788909099.783779:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.783873:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019493888 00000100:00100000:3.0:1788909099.783879:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019493888 00000100:00100000:3.0:1788909099.783931:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788909099.783940:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019493888:12345-0@lo:501: 00000100:00100000:3.0:1788909099.785269:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019493888:12345-0@lo:501: Request processed in 1319us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909099.785283:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788909099.785980:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.786012:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019493888:0@lo:501: 00000100:00100000:2.0:1788909099.786311:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019494016:0@lo:503: 00000100:00100000:2.0:1788909099.786400:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909099.786524:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909099.786624:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019494016 00000100:00100000:3.0:1788909099.786632:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019494016 00000100:00100000:3.0:1788909099.786746:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788909099.786756:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019494016:12345-0@lo:503: 00000100:00100000:3.0:1788909099.787318:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019494016:12345-0@lo:503: Request processed in 290us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909099.787328:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788909099.787434:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019494016:0@lo:503: 00000100:00100000:1.0:1788909099.789282:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8465:1875807019494144:0@lo:502: 00000100:00100000:1.0:1788909099.789376:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909099.791651:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909099.791736:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019494144 00000100:00100000:0.0:1788909099.791748:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019494144 00000100:00100000:0.0:1788909099.791810:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788909099.791821:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:8465:x1875807019494144:12345-0@lo:502: 00000100:00100000:0.0:1788909099.792729:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:8465:x1875807019494144:12345-0@lo:502: Request processed in 907us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909099.792739:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788909099.794013:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8465:1875807019494144:0@lo:502: 00000100:00100000:1.0:1788909099.794402:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8465:1875807019494272:0@lo:502: 00000100:00100000:1.0:1788909099.794625:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909099.794730:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.794779:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019494272 00000100:00100000:2.0:1788909099.794786:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019494272 00000100:00100000:2.0:1788909099.794891:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788909099.794901:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:8465:x1875807019494272:12345-0@lo:502: 00000100:00100000:2.0:1788909099.795894:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+13:8465:x1875807019494272:12345-0@lo:502: Request processed in 990us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.795918:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788909099.796344:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8465:1875807019494272:0@lo:502: 00000040:00080000:1.0:1788909099.796390:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788909099.796749:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788909099.796773:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788909099.796787:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.796800:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909099.796810:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788909099.796812:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788909099.796815:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788909099.796858:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.796865:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.796874:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909099.796894:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019494400:0@lo:101: 00000100:00100000:2.0:1788909099.797023:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909099.797713:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909099.797799:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019494400 00000100:00100000:0.0:1788909099.797807:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019494400 00000100:00100000:0.0:1788909099.797901:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788909099.797913:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+13:5820:x1875807019494400:12345-0@lo:101: 00010000:00010000:0.0:1788909099.797938:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909099.797954:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9c200/0x733cfdd8721d55f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d55ea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909099.797982:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9c200/0x733cfdd8721d55f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d55ea expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909099.797993:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9c200/0x733cfdd8721d55f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d55ea expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909099.798003:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9c200, rc 0) 00000100:00100000:0.0:1788909099.798078:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019494400:12345-0@lo:101: Request processed in 168us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.798636:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019494400:0@lo:101: 00010000:00010000:2.0:1788909099.798655:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.798665:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909099.798757:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019494528:0@lo:501: 00000100:00100000:2.0:1788909099.798799:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909099.798853:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788909099.799611:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019494528 00000100:00100000:0.0:1788909099.799621:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019494528 00000100:00100000:2.0:1788909099.799697:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788909099.799752:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788909099.799766:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019494528:12345-0@lo:501: 00000100:00100000:1.0:1788909099.800635:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019494528:12345-0@lo:501: Request processed in 870us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909099.800642:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788909099.800893:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019494528:0@lo:501: 00000100:00100000:2.0:1788909099.800954:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019494656:0@lo:503: 00000100:00100000:2.0:1788909099.801010:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909099.801501:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788909099.801726:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019494656 00000100:00100000:1.0:1788909099.801733:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019494656 00000100:00100000:1.0:1788909099.801769:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788909099.801778:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019494656:12345-0@lo:503: 00000100:00100000:1.0:1788909099.802153:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019494656:12345-0@lo:503: Request processed in 374us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909099.802160:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788909099.802629:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019494656:0@lo:503: 00000100:00100000:1.0:1788909099.803632:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8466:1875807019494784:0@lo:502: 00000100:00100000:1.0:1788909099.803711:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909099.803748:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909099.803812:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019494784 00000100:00100000:3.0:1788909099.803822:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019494784 00000100:00100000:3.0:1788909099.803878:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788909099.803888:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+14:8466:x1875807019494784:12345-0@lo:502: 00000100:00100000:3.0:1788909099.804646:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+14:8466:x1875807019494784:12345-0@lo:502: Request processed in 757us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909099.804655:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788909099.804803:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8466:1875807019494784:0@lo:502: 00000020:01000000:1.0:1788909099.804835:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788909099.804845:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788909099.804847:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788909099.804852:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788909099.804877:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8466:1875807019494912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788909099.804914:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909099.805367:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909099.805602:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019494912 00000100:00100000:3.0:1788909099.805609:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019494912 00000100:00100000:3.0:1788909099.805652:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788909099.805660:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+14:8466:x1875807019494912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.805832:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+14:8466:x1875807019494912:12345-0@lo:502:llog_process_th.0 Request processed in 172us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909099.805847:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788909099.805942:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8466:1875807019494912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788909099.805965:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909099.805970:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909099.805972:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788909099.805975:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788909099.806591:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788909099.806614:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788909099.806623:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.806636:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909099.806646:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788909099.806649:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905068d9800 from 39 10000000:01000000:3.0:1788909099.806652:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788909099.806681:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.806690:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.806699:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909099.806719:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.806760:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.806798:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.806849:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019495040 00000100:00100000:2.0:1788909099.806855:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019495040 00000100:00100000:2.0:1788909099.806891:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788909099.806899:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+14:5820:x1875807019495040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909099.806908:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909099.806991:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501535400/0x733cfdd8721d55ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d55f8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.807015:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501535400/0x733cfdd8721d55ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d55f8 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.807026:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501535400/0x733cfdd8721d55ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d55f8 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.807210:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501535400, rc 0) 00000100:00100000:2.0:1788909099.807326:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019495040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 427us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.807332:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788909099.807563:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788909099.807577:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909099.807586:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909099.807648:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788909099.807679:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909099.807710:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.807752:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019495168 00000100:00100000:2.0:1788909099.807756:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019495168 00000100:00100000:2.0:1788909099.807792:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788909099.807799:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019495168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788909099.809371:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788909099.809625:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788909099.809690:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909099.809731:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.809785:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019495168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1116us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.809797:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788909099.809830:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019495296 00000100:00100000:2.0:1788909099.809836:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019495296 00000100:00100000:2.0:1788909099.809874:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788909099.809882:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019495296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909099.810677:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019495296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 792us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.810686:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788909099.810758:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.814696:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8467:1875807019495424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.814817:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.814876:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788909099.814952:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019495424 00000100:00100000:1.0:1788909099.814961:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019495424 00000100:00100000:1.0:1788909099.815039:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788909099.815058:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+15:8467:x1875807019495424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788909099.815745:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+15:8467:x1875807019495424:12345-0@lo:502:llog_process_th.0 Request processed in 687us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909099.815755:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788909099.816068:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8467:1875807019495424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.816175:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8467:1875807019495552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.816215:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.816638:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.816690:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019495552 00000100:00100000:2.0:1788909099.816697:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019495552 00000100:00100000:2.0:1788909099.816737:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788909099.816746:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:8467:x1875807019495552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909099.816970:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+15:8467:x1875807019495552:12345-0@lo:502:llog_process_th.0 Request processed in 225us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.816978:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788909099.817824:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8467:1875807019495552:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788909099.817874:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788909099.818682:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788909099.818709:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788909099.818723:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.818735:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909099.818745:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788909099.818748:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788909099.818751:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788909099.818793:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.818802:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.818812:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909099.818836:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788909099.818899:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909099.818953:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788909099.819009:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019495680 00000100:00100000:1.0:1788909099.819015:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019495680 00000100:00100000:1.0:1788909099.819074:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788909099.819083:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+15:5820:x1875807019495680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788909099.819095:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909099.819127:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501693a00/0x733cfdd8721d560d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5606 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909099.819159:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501693a00/0x733cfdd8721d560d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5606 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909099.819169:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501693a00/0x733cfdd8721d560d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5606 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909099.819179:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693a00, rc 0) 00000100:00100000:1.0:1788909099.819214:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019495680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909099.819419:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788909099.820829:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909099.820854:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.820866:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909099.820951:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.821005:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.821337:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788909099.821612:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019495808 00000100:00100000:1.0:1788909099.821620:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019495808 00000100:00100000:1.0:1788909099.821674:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788909099.821684:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019495808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788909099.821986:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019495808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909099.821994:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788909099.822908:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.822977:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.823312:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.823360:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.823653:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019495936 00000100:00100000:2.0:1788909099.823661:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019495936 00000100:00100000:2.0:1788909099.823718:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788909099.823730:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019495936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909099.823985:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019495936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.823993:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788909099.824654:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019495936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909099.826695:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8468:1875807019496064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909099.826786:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909099.826870:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909099.826912:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019496064 00000100:00100000:1.0:1788909099.826919:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019496064 00000100:00100000:1.0:1788909099.827620:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788909099.827634:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+16:8468:x1875807019496064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788909099.828806:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+16:8468:x1875807019496064:12345-0@lo:502:llog_process_th.0 Request processed in 1171us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909099.828817:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788909099.828993:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8468:1875807019496064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788909099.829036:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788909099.829058:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909099.829061:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788909099.829065:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788909099.829101:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8468:1875807019496192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909099.829174:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909099.829802:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909099.829864:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019496192 00000100:00100000:3.0:1788909099.829872:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019496192 00000100:00100000:3.0:1788909099.829958:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788909099.829968:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:8468:x1875807019496192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.830853:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:8468:x1875807019496192:12345-0@lo:502:llog_process_th.0 Request processed in 884us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909099.830863:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788909099.830975:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8468:1875807019496192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788909099.831010:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909099.831018:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909099.831020:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788909099.831024:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788909099.831609:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788909099.831628:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788909099.831638:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.831649:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909099.831658:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788909099.831661:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905103af000 from 39 10000000:01000000:3.0:1788909099.831664:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788909099.831700:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.831708:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.831716:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909099.831737:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019496320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.831783:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.831824:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788909099.831875:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019496320 00000100:00100000:1.0:1788909099.831882:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019496320 00000100:00100000:1.0:1788909099.832015:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788909099.832026:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019496320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788909099.832053:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909099.832066:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501693c00/0x733cfdd8721d561b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5614 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909099.832090:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501693c00/0x733cfdd8721d561b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5614 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909099.832100:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501693c00/0x733cfdd8721d561b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5614 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909099.832158:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693c00, rc 0) 00000100:00100000:1.0:1788909099.832197:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019496320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909099.832202:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788909099.832284:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019496320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909099.832297:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.832312:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909099.832357:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019496448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.832381:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.832981:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788909099.833417:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019496448 00000100:00100000:0.0:1788909099.833592:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019496448 00000100:00100000:0.0:1788909099.833637:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788909099.833645:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019496448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909099.833955:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019496448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909099.833963:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788909099.834079:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019496448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.834159:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019496576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.834252:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.834275:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788909099.834689:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019496576 00000100:00100000:0.0:1788909099.834696:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019496576 00000100:00100000:0.0:1788909099.834723:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788909099.834730:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019496576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909099.834898:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019496576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909099.834905:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788909099.834992:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019496576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.835799:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8469:1875807019496704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.835851:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.835886:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788909099.835942:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019496704 00000100:00100000:0.0:1788909099.835948:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019496704 00000100:00100000:0.0:1788909099.835973:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788909099.835980:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:8469:x1875807019496704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909099.836718:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:8469:x1875807019496704:12345-0@lo:502:llog_process_th.0 Request processed in 736us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909099.836727:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788909099.836822:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8469:1875807019496704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.836875:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8469:1875807019496832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.836912:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.836937:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788909099.837371:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019496832 00000100:00100000:0.0:1788909099.837377:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019496832 00000100:00100000:0.0:1788909099.837550:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788909099.837559:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:8469:x1875807019496832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909099.837753:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:8469:x1875807019496832:12345-0@lo:502:llog_process_th.0 Request processed in 194us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909099.837760:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788909099.837848:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8469:1875807019496832:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788909099.837878:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788909099.838736:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788909099.838758:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788909099.838768:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.838779:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909099.838790:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788909099.838792:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788909099.838795:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788909099.838826:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.838844:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.838855:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909099.838876:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019496960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788909099.839600:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909099.839695:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909099.839732:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019496960 00000100:00100000:0.0:1788909099.839740:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019496960 00000100:00100000:0.0:1788909099.839820:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788909099.839830:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019496960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788909099.839842:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909099.839857:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9dc00/0x733cfdd8721d5629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5622 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909099.839881:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9dc00/0x733cfdd8721d5629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5622 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909099.839891:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9dc00/0x733cfdd8721d5629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5622 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909099.839899:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9dc00, rc 0) 00000100:00100000:0.0:1788909099.840021:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019496960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909099.840028:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788909099.840337:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019496960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909099.840353:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.840374:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909099.840632:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019497088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.840663:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.840785:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.840878:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019497088 00000100:00100000:2.0:1788909099.840883:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019497088 00000100:00100000:2.0:1788909099.840908:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788909099.840916:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019497088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909099.841625:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019497088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 708us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.841635:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788909099.841709:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019497088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.841744:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019497216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.841787:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.841818:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.841978:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019497216 00000100:00100000:2.0:1788909099.841983:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019497216 00000100:00100000:2.0:1788909099.842006:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788909099.842012:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019497216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909099.842618:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019497216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 604us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.842627:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788909099.842773:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019497216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.843742:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8470:1875807019497344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.843810:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.843860:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.843905:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019497344 00000100:00100000:2.0:1788909099.843913:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019497344 00000100:00100000:2.0:1788909099.843958:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788909099.843976:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:8470:x1875807019497344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909099.844809:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:8470:x1875807019497344:12345-0@lo:502:llog_process_th.0 Request processed in 830us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.844820:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788909099.844944:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8470:1875807019497344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909099.844982:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909099.844992:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909099.844995:0:8470:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788909099.845000:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788909099.845040:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8470:1875807019497472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909099.845084:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909099.845315:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909099.845550:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019497472 00000100:00100000:2.0:1788909099.845556:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019497472 00000100:00100000:2.0:1788909099.845588:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788909099.845596:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:8470:x1875807019497472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909099.845775:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:8470:x1875807019497472:12345-0@lo:502:llog_process_th.0 Request processed in 179us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909099.845782:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788909099.845901:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8470:1875807019497472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909099.845931:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909099.845937:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909099.845939:0:8470:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788909099.845943:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788909099.846726:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788909099.846750:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788909099.846761:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.846772:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909099.846782:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788909099.846784:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff890508884d28 from 1 10000000:01000000:2.0:1788909099.846787:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788909099.846818:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.846826:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.846837:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909099.846868:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019497600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788909099.846914:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909099.846962:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909099.847005:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019497600 00000100:00100000:3.0:1788909099.847011:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019497600 00000100:00100000:3.0:1788909099.847062:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788909099.847073:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019497600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909099.847085:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909099.847100:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89050bad8400/0x733cfdd8721d5637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5630 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.847166:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad8400/0x733cfdd8721d5637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5630 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.847176:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89050bad8400/0x733cfdd8721d5637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5630 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909099.847185:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad8400, rc 0) 00000100:00100000:3.0:1788909099.847346:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019497600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909099.847353:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788909099.847661:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019497600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909099.847675:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5637 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.847684:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5637 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909099.847739:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019497728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909099.847767:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909099.847796:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909099.847832:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019497728 00000100:00100000:3.0:1788909099.847836:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019497728 00000100:00100000:3.0:1788909099.847854:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788909099.847860:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019497728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909099.848320:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019497728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 458us (550us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788909099.848337:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788909099.848634:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019497728:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788909099.848668:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788909099.848675:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5637 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909099.848684:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5637 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909100.166706:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019497984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909100.166794:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909100.166816:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019498112:0@lo:400:kworker.0 00000100:00100000:2.0:1788909100.166859:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909100.166877:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019497856:0@lo:400:kworker.0 00000100:00100000:1.0:1788909100.166917:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909100.166967:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019497984 00000100:00100000:1.0:1788909100.166975:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019497984 00000100:00100000:1.0:1788909100.167038:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788909100.167052:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019497984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909100.167139:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909100.167188:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019497984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909100.167195:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788909100.167222:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909100.167239:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019498496:0@lo:400:kworker.0 00000100:00100000:1.0:1788909100.167283:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788909100.167324:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cb90700 x1875807019497984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909100.167342:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019497984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909100.167366:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019498112 00000100:00100000:1.0:1788909100.167370:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019498112 00000100:00100000:1.0:1788909100.167410:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019498496 00000100:00100000:1.0:1788909100.167414:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019498496 00000100:00100000:1.0:1788909100.167438:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788909100.167445:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019498112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909100.172441:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019498368:0@lo:400:kworker.0 00000100:00100000:3.0:1788909100.172546:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909100.172608:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788909100.172616:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019498240:0@lo:400:kworker.0 00000100:00100000:3.0:1788909100.172642:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909100.172676:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019498240 00000100:00100000:3.0:1788909100.172683:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019498240 00000100:00100000:3.0:1788909100.172730:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788909100.172738:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019498496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909100.173040:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019498496:12345-0@lo:400:kworker.0 Request processed in 66us (5519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909100.173048:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788909100.173068:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788909100.173075:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019498240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909100.173133:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019498240:12345-0@lo:400:kworker.0 Request processed in 59us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909100.173139:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788909100.173179:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019498240:0@lo:400:kworker.0 00000100:00100000:3.0:1788909100.173213:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019498496:0@lo:400:kworker.0 00000100:00100000:3.0:1788909100.173236:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019497856 00000100:00100000:3.0:1788909100.173240:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019497856 00000100:00100000:3.0:1788909100.173290:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788909100.173296:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019497856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909100.173428:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019497856:12345-0@lo:400:kworker.0 Request processed in 131us (6510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909100.173434:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788909100.173463:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019497856:0@lo:400:kworker.0 00000100:00080000:3.0:1788909100.173700:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909100.173734:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019498368 00000100:00100000:3.0:1788909100.173738:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019498368 00000100:00100000:3.0:1788909100.173768:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788909100.173776:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019498368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909100.173943:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019498368:12345-0@lo:400:kworker.0 Request processed in 167us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909100.173949:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788909100.173980:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890510385500 x1875807019498368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909100.173991:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019498368:0@lo:400:kworker.0 00000100:00100000:1.0:1788909100.183604:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019498112:12345-0@lo:400:kworker.0 Request processed in 16144us (16730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909100.183615:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019498112:0@lo:400:kworker.0 00000100:00100000:1.0:1788909100.183624:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788909100.741733:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909101.765813:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909102.299656:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909102.300271:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004791552 00000100:00100000:1.0:1788909102.300284:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004791552 00000100:00100000:1.0:1788909102.300370:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:1.0:1788909102.300383:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:5591:x1875807004791552:12345-192.168.204.54@tcp:101: 00010000:00010000:1.0:1788909102.300411:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909102.300435:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501692a00/0x733cfdd8721d563e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a4449f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909102.300491:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501692a00/0x733cfdd8721d563e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4449f expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909102.300505:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501692a00/0x733cfdd8721d563e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4449f expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909102.300517:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692a00, rc 0) 00000100:00100000:1.0:1788909102.300606:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5591:x1875807004791552:12345-192.168.204.54@tcp:101: Request processed in 225us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909102.300614:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:1.0:1788909102.317087:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909102.317334:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004791680 00000100:00100000:3.0:1788909102.317350:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004791680 00000100:00100000:3.0:1788909102.317435:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:3.0:1788909102.317448:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5591:x1875807004791680:12345-192.168.204.54@tcp:501: 00000100:00100000:3.0:1788909102.317890:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5591:x1875807004791680:12345-192.168.204.54@tcp:501: Request processed in 444us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909102.317899:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:0.0:1788909102.320642:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909102.320780:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004791808 00000100:00100000:3.0:1788909102.320793:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004791808 00000100:00100000:3.0:1788909102.321079:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:3.0:1788909102.321150:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5591:x1875807004791808:12345-192.168.204.54@tcp:503: 00000100:00100000:3.0:1788909102.321451:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5591:x1875807004791808:12345-192.168.204.54@tcp:503: Request processed in 340us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909102.321460:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1788909102.338552:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909102.340277:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004791936 00000100:00100000:1.0:1788909102.340304:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004791936 00000100:00100000:1.0:1788909102.340690:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:1.0:1788909102.340707:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:6078:x1875807004791936:12345-192.168.204.54@tcp:502: 00000100:00100000:1.0:1788909102.341257:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:6078:x1875807004791936:12345-192.168.204.54@tcp:502: Request processed in 552us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909102.341268:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:1.0:1788909102.347163:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909102.349996:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004792064 00000100:00100000:3.0:1788909102.350020:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004792064 00000100:00100000:2.0:1788909102.350284:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:2.0:1788909102.350301:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:6078:x1875807004792064:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788909102.350706:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:6078:x1875807004792064:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 406us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909102.350715:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:3.0:1788909102.358000:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909102.360621:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004792192 00000100:00100000:1.0:1788909102.360646:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004792192 00000100:00100000:1.0:1788909102.360750:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:1.0:1788909102.360762:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5591:x1875807004792192:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788909102.361207:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909102.361337:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501693200/0x733cfdd8721d5645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a444a6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909102.361387:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501693200/0x733cfdd8721d5645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444a6 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909102.361402:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501693200/0x733cfdd8721d5645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444a6 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909102.361414:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693200, rc 0) 00000100:00100000:1.0:1788909102.361670:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5591:x1875807004792192:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 909us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909102.361679:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1788909102.364468:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909102.364772:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004792320 00000100:00100000:0.0:1788909102.364804:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004792320 00000100:00100000:0.0:1788909102.364881:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:0.0:1788909102.364895:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5591:x1875807004792320:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909102.365785:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5591:x1875807004792320:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 887us (1332us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788909102.365797:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00010000:00010000:0.0:1788909102.790025:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788909103.683403:0:8507:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefacf1f10 20000000:00000080:2.0:1788909103.683427:0:8507:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890537efb800 uarg=0000000000000000 20000000:01000000:2.0:1788909103.683491:0:8507:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788909103.683498:0:8507:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788909103.683505:0:8507:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788909103.684866:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788909103.685029:0:8507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788909103.691691:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788909103.691750:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788909103.691808:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788909103.691826:0:8507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788909103.691846:0:8507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.691865:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890504d9da00/0x733cfdd8721d53c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d53ba expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.691874:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d541c expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.691881:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d54e7 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.691889:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4446e expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.691896:0:8507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.691948:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4446e expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.691964:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4446e expref: 9 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.691979:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875807019498624:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909103.692178:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d54e7 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.692187:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d54e7 expref: 18 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.692198:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875807019498752:0@lo:104: 00000100:00100000:0.0:1788909103.692237:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788909103.692276:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d541c expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.692285:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d541c expref: 18 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.692293:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875807019498880:0@lo:104: 00000100:00100000:0.0:1788909103.692316:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788909103.692342:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890504d9da00/0x733cfdd8721d53c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d53ba expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.692349:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890504d9da00/0x733cfdd8721d53c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d53ba expref: 18 pid: 5817 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.692369:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875807019499008:0@lo:104: 00000100:00100000:0.0:1788909103.692389:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905053c86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909103.692832:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788909103.692850:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909103.692879:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019498752 00000100:00100000:2.0:1788909103.692886:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019498752 00000100:00100000:3.0:1788909103.692952:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019498880 00000100:00100000:3.0:1788909103.692958:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019498880 00000100:00100000:0.0:1788909103.692973:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019499008 00000100:00100000:0.0:1788909103.692979:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019499008 00000100:00100000:3.0:1788909103.692987:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788909103.692999:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+5:8507:x1875807019498752:12345-0@lo:104: 00000100:00100000:0.0:1788909103.693006:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788909103.693013:0:7631:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.693016:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dce5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+5:8507:x1875807019498880:12345-0@lo:104: 00010000:00010000:0.0:1788909103.693033:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693095:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788909103.693178:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+5:8507:x1875807019498752:12345-0@lo:104: Request processed in 106us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909103.693349:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788909103.693372:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788909103.693373:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788909103.693383:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dce5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+4:8507:x1875807019498880:12345-0@lo:104: Request processed in 368us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909103.693386:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+4:8507:x1875807019499008:12345-0@lo:104: 00000100:00100000:0.0:1788909103.693397:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788909103.693399:0:7631:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693446:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788909103.693463:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+3:8507:x1875807019499008:12345-0@lo:104: Request processed in 69us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909103.693469:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788909103.693512:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788909103.693519:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693526:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535000 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:3.0:1788909103.693531:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693540:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788909103.693547:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909103.693553:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788909103.693586:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693592:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788909103.693625:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693633:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501535000/0x733cfdd8721d54e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d54ee expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693645:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788909103.693647:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693653:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c000 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:3.0:1788909103.693719:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693732:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788909103.693738:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909103.693743:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788909103.693752:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875807019498752:0@lo:104: 00010000:00010000:3.0:1788909103.693760:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.693765:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875807019498880:0@lo:104: 00010000:00010000:3.0:1788909103.693773:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788909103.693778:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875807019499008:0@lo:104: 00010000:00010000:3.0:1788909103.693794:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693803:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890504d9c000/0x733cfdd8721d541c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5423 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693814:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909103.693817:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693823:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:3.0:1788909103.693826:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693833:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909103.693836:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788909103.693842:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909103.693854:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788909103.693892:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693898:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788909103.693905:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693912:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d53ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d53c1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.693927:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909103.693929:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909103.693930:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909103.693938:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909103.693951:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019499136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788909103.693990:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909103.694047:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019499264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788909103.694070:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909103.694096:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909103.694102:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019499392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788909103.694177:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909103.696756:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019499136 00000100:00100000:0.0:1788909103.696774:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019499136 00010000:00010000:0.0:1788909103.696825:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d54e7 expref: 19 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.696859:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019499264 00000100:00100000:0.0:1788909103.696863:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019499264 00010000:00010000:0.0:1788909103.696876:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d541c expref: 20 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.696887:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019499392 00000100:00100000:0.0:1788909103.696907:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019499392 00010000:00010000:0.0:1788909103.696923:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890504d9da00/0x733cfdd8721d53c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d53ba expref: 21 pid: 5817 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.696939:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788909103.696949:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+21:3284:x1875807019499136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788909103.696967:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909103.696973:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d54e7 expref: 21 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.696985:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d54e7 expref: 21 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.697004:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501693000/0x733cfdd8721d54ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d54e7 expref: 21 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.697023:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909103.697092:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+20:3284:x1875807019499136:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (3100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909103.697100:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788909103.697145:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788909103.697163:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019499264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788909103.697171:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909103.697175:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d541c expref: 19 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.697184:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d541c expref: 19 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.697194:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d541c expref: 19 pid: 5815 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.697211:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909103.697240:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+18:3285:x1875807019499264:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909103.697247:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788909103.697260:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788909103.697266:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+17:3285:x1875807019499392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788909103.697273:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909103.697277:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890504d9da00/0x733cfdd8721d53c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d53ba expref: 17 pid: 5817 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.697284:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890504d9da00/0x733cfdd8721d53c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d53ba expref: 17 pid: 5817 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.697293:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9da00/0x733cfdd8721d53c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d53ba expref: 17 pid: 5817 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.697302:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909103.697325:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+16:3285:x1875807019499392:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (3147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909103.697331:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788909103.697387:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1875807019498624:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909103.697423:0:8507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909103.697604:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019499136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788909103.697631:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019499392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788909103.697638:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019499264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909103.698529:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909103.698604:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004792448 00000100:00100000:0.0:1788909103.698612:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004792448 00010000:00010000:0.0:1788909103.698637:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4446e expref: 10 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909103.698682:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788909103.698689:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2349:x1875807004792448:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909103.698701:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909103.698705:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4446e expref: 10 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698715:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4446e expref: 10 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698729:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad9a00/0x733cfdd8721d55ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4446e expref: 10 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698744:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698752:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698766:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698772:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698778:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698784:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698802:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d400 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909103.698807:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698815:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698832:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909103.698843:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909103.698892:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:2349:x1875807004792448:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 202us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909103.698900:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00010000:00010000:3.0:1788909103.699364:0:8507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.699374:0:8507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909103.699381:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9d400/0x733cfdd8721d564c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909103.815983:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909104.112467:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909104.113645:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004792576 00000100:00100000:2.0:1788909104.113659:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004792576 00000100:00100000:2.0:1788909104.113734:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:2.0:1788909104.113745:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:5591:x1875807004792576:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909104.113763:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909104.113786:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a444ad expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.113841:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444ad expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.113852:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444ad expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.113861:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10e00, rc 0) 00000100:00100000:2.0:1788909104.113923:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5591:x1875807004792576:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 180us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909104.113930:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:1.0:1788909104.130473:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909104.130881:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004792704 00000100:00100000:3.0:1788909104.130895:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004792704 00000100:00100000:3.0:1788909104.131001:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:3.0:1788909104.131012:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5591:x1875807004792704:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.131426:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5591:x1875807004792704:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 415us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.131436:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:2.0:1788909104.133612:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909104.138622:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004792832 00000100:00100000:3.0:1788909104.138641:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004792832 00000100:00100000:3.0:1788909104.138718:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:3.0:1788909104.138730:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5591:x1875807004792832:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.140336:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:5591:x1875807004792832:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 1591us (6714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.140355:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:1.0:1788909104.144673:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909104.144764:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004792960 00000100:00100000:3.0:1788909104.144774:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004792960 00000100:00100000:3.0:1788909104.144843:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:3.0:1788909104.144874:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:6135:x1875807004792960:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788909104.145189:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:6135:x1875807004792960:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 317us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.145197:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:1.0:1788909104.148208:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909104.151517:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004793088 00000100:00100000:3.0:1788909104.151534:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004793088 00000100:00100000:3.0:1788909104.151664:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:3.0:1788909104.151676:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:6135:x1875807004793088:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788909104.153869:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:6135:x1875807004793088:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 2183us (5661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.153883:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:3.0:1788909104.261875:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019499520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909104.261968:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909104.262101:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019499520 00000100:00100000:1.0:1788909104.262147:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019499520 00000100:00100000:1.0:1788909104.262219:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788909104.262230:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909104.262237:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019499520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788909104.262273:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909104.262319:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019499520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909104.262327:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788909104.262452:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcb2a00 x1875807019499520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909104.262478:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019499520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788909104.730660:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909104.730712:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909104.730738:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909104.730957:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004793344 00000100:00100000:3.0:1788909104.730968:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004793344 00000100:00100000:3.0:1788909104.731034:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004793472 00000100:00100000:3.0:1788909104.731038:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004793472 00000100:00100000:3.0:1788909104.731076:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788909104.731085:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004793344:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:2.0:1788909104.731298:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788909104.731303:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909104.731310:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004793216 00000100:00100000:0.0:1788909104.731315:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004793216 00000100:00100000:0.0:1788909104.731364:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1788909104.731372:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2348:x1875807004793216:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909104.731457:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2348:x1875807004793216:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 86us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909104.731465:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1788909104.731499:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788909104.731506:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004793472:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:2.0:1788909104.731519:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909104.731533:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004793472:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909104.731539:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788909104.731770:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004793344:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 686us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.731785:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 10000000:01000000:3.0:1788909104.838756:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788909104.838766:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905375be800 from 4 10000000:01000000:3.0:1788909104.838772:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788909104.838834:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.838848:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.838863:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909104.838899:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019499648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.838993:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909104.839056:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.839155:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019499648 00000100:00100000:3.0:1788909104.839165:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019499648 00000100:00100000:3.0:1788909104.839231:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788909104.839241:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019499648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909104.839259:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909104.839276:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d565a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.839305:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d565a expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.839316:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d565a expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.839337:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9e00, rc 0) 00000100:00100000:3.0:1788909104.839381:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019499648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.839388:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788909104.839455:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019499648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909104.839473:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.839482:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909104.839543:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019499776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.839570:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909104.839592:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89052d67ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.839606:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019499776 00000100:00100000:3.0:1788909104.839609:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019499776 00000100:00100000:3.0:1788909104.839631:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788909104.839637:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019499776:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:0.0:1788909104.839701:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909104.840001:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019499776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 363us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.840007:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788909104.840266:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019499776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909104.840308:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019499904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909104.840361:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909104.840383:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.843330:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019499904 00000100:00100000:3.0:1788909104.843422:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019499904 00000100:00100000:3.0:1788909104.843503:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788909104.843513:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019499904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.843843:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019499904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 330us (3479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.843853:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788909104.843989:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019499904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909104.847379:0:8566:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8566:1875807019500032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909104.847491:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909104.847882:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019500032 00000100:00100000:0.0:1788909104.847893:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019500032 00000100:00100000:0.0:1788909104.847947:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788909104.847955:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:8566:x1875807019500032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909104.848381:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:8566:x1875807019500032:12345-0@lo:502:llog_process_th.0 Request processed in 425us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909104.848391:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788909104.848459:0:8566:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788909104.848486:0:8566:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8566:1875807019500032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788909104.848522:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909104.848534:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909104.848536:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788909104.848682:0:8566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8905375be800 00000020:00000080:0.0:1788909104.848684:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788909104.848964:0:8566:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8566:1875807019500160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909104.849008:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909104.849042:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019500160 00000100:00100000:0.0:1788909104.849053:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019500160 00000100:00100000:0.0:1788909104.849089:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788909104.849098:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+17:8566:x1875807019500160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909104.849318:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+17:8566:x1875807019500160:12345-0@lo:502:llog_process_th.0 Request processed in 221us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909104.849327:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788909104.849368:0:8566:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788909104.849385:0:8566:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8566:1875807019500160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788909104.849409:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909104.849415:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909104.849417:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788909104.849421:0:8566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788909104.853370:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788909104.853402:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788909104.853413:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.853426:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909104.853447:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788909104.853450:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905068d9800 from 4 10000000:01000000:2.0:1788909104.853459:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788909104.853495:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.853504:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.853516:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909104.853552:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019500288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788909104.853620:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909104.853668:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788909104.853690:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019500288 00000100:00100000:2.0:1788909104.853697:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019500288 00000100:00100000:2.0:1788909104.853756:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788909104.853766:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019500288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909104.853790:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909104.853804:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5668 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.853828:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5668 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.853838:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5668 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.853847:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11c00, rc 0) 00000100:00100000:2.0:1788909104.853884:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019500288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909104.853901:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788909104.853953:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019500288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909104.853967:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909104.853976:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909104.854028:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019500416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909104.854053:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909104.854070:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788909104.854081:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019500416 00000100:00100000:2.0:1788909104.854084:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019500416 00000100:00100000:2.0:1788909104.854106:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788909104.854137:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019500416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909104.855661:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019500416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1518us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909104.855673:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788909104.856065:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019500416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909104.856140:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019500544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909104.856190:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909104.856287:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788909104.856309:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019500544 00000100:00100000:2.0:1788909104.856314:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019500544 00000100:00100000:2.0:1788909104.856346:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788909104.856363:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019500544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909104.858297:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019500544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909104.858315:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788909104.861298:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019500544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.861625:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8570:1875807019500672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909104.861698:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909104.861743:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019500672 00000100:00100000:3.0:1788909104.861750:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019500672 00000100:00100000:3.0:1788909104.861793:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788909104.861801:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:8570:x1875807019500672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909104.863277:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:8570:x1875807019500672:12345-0@lo:502:llog_process_th.0 Request processed in 1471us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.863289:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788909104.863497:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.863523:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8570:1875807019500672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909104.863554:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909104.863574:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909104.863577:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788909104.863584:0:8570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8905068d9800 00000020:00000080:3.0:1788909104.863586:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788909104.864669:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8570:1875807019500800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909104.864733:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909104.864777:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019500800 00000100:00100000:3.0:1788909104.864784:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019500800 00000100:00100000:3.0:1788909104.864837:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788909104.864847:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:8570:x1875807019500800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909104.865097:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:8570:x1875807019500800:12345-0@lo:502:llog_process_th.0 Request processed in 251us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.866283:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788909104.866437:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.866463:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8570:1875807019500800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909104.866504:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909104.866514:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909104.866517:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788909104.866521:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788909104.866620:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788909104.866647:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788909104.866658:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.866668:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909104.866678:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788909104.866681:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905103af000 from 4 10000000:01000000:3.0:1788909104.866684:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788909104.866714:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.866722:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.866732:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909104.866752:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019500928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.866813:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909104.866838:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.866858:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019500928 00000100:00100000:3.0:1788909104.866864:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019500928 00000100:00100000:3.0:1788909104.868259:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788909104.868271:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019500928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909104.868295:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909104.868314:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d5676 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.868343:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d5676 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.868366:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5676 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.868375:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9000, rc 0) 00000100:00100000:3.0:1788909104.868451:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019500928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.868458:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788909104.868534:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019500928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909104.868556:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.868567:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909104.868652:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019501056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.868695:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909104.868723:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.868735:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019501056 00000100:00100000:3.0:1788909104.868739:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019501056 00000100:00100000:3.0:1788909104.868760:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788909104.868767:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019501056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.870325:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019501056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1550us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.870339:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788909104.870504:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019501056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.870566:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019501184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.870618:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909104.870636:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.870650:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019501184 00000100:00100000:3.0:1788909104.870656:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019501184 00000100:00100000:3.0:1788909104.870686:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788909104.870693:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019501184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909104.870868:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019501184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.870875:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788909104.870924:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019501184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909104.875342:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8571:1875807019501312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909104.875451:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909104.875493:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.875502:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019501312 00000100:00100000:3.0:1788909104.875511:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019501312 00000100:00100000:3.0:1788909104.875559:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788909104.875569:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:8571:x1875807019501312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909104.875845:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:8571:x1875807019501312:12345-0@lo:502:llog_process_th.0 Request processed in 277us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.875854:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788909104.875915:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8571:1875807019501312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909104.875945:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909104.875955:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909104.875958:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788909104.875964:0:8571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8905103af000 00000020:00000080:3.0:1788909104.875966:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788909104.876039:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8571:1875807019501440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909104.876074:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909104.876089:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508f0c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909104.876826:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019501440 00000100:00100000:3.0:1788909104.876835:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019501440 00000100:00100000:3.0:1788909104.876881:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788909104.876890:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:8571:x1875807019501440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909104.878284:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:8571:x1875807019501440:12345-0@lo:502:llog_process_th.0 Request processed in 1386us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909104.878297:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788909104.878478:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:8571:1875807019501440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909104.878531:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909104.878542:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909104.878544:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788909104.878549:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788909104.878686:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788909104.878709:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788909104.878718:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909104.878736:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909105.286871:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019501952:0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.286944:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909105.287005:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788909105.287011:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019501568:0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287038:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909105.287061:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019502080:0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287083:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909105.287127:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019501696:0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287349:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909105.287384:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019502208:0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287411:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909105.287443:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909105.287448:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019501824:0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287472:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909105.287508:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019501952 00000100:00100000:3.0:1788909105.287517:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019501952 00000100:00100000:3.0:1788909105.287566:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019502208 00000100:00100000:3.0:1788909105.287569:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019502208 00000100:00100000:3.0:1788909105.287601:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788909105.287610:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019501952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287667:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019501952:12345-0@lo:400:kworker.0 Request processed in 58us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909105.287685:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788909105.287704:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909105.287709:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019502208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287738:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019502208:12345-0@lo:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909105.287743:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909105.287758:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019501568 00000100:00100000:3.0:1788909105.287761:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019501568 00000100:00100000:3.0:1788909105.287781:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788909105.287787:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019501568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287811:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019501568:12345-0@lo:400:kworker.0 Request processed in 25us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909105.287817:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788909105.287843:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019502080 00000100:00100000:3.0:1788909105.287846:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019502080 00000100:00100000:3.0:1788909105.287872:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019501696 00000100:00100000:3.0:1788909105.287875:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019501696 00000100:00100000:3.0:1788909105.287884:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019501824 00000100:00100000:3.0:1788909105.287886:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019501824 00000100:00100000:3.0:1788909105.287898:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788909105.287904:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019502080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287932:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019502080:12345-0@lo:400:kworker.0 Request processed in 28us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909105.287938:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788909105.287948:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788909105.287953:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019501696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.287990:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019501696:12345-0@lo:400:kworker.0 Request processed in 37us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909105.287997:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788909105.288008:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788909105.288013:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019501824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.288037:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019501824:12345-0@lo:400:kworker.0 Request processed in 25us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909105.288043:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788909105.288069:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788909105.288075:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788909105.288140:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019501824:0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.288153:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019501696:0@lo:400:kworker.0 00010000:00080000:3.0:1788909105.288182:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cb93800 x1875807019502208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909105.288194:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019502208:0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.288235:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019501568:0@lo:400:kworker.0 00000100:00100000:3.0:1788909105.288244:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019502080:0@lo:400:kworker.0 00010000:00080000:3.0:1788909105.288253:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cb91c00 x1875807019501952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909105.288261:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019501952:0@lo:400:kworker.0 00000100:00100000:0.0:1788909105.294255:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019502336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909105.294324:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909105.294381:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019502336 00000100:00100000:1.0:1788909105.294391:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019502336 00000100:00100000:1.0:1788909105.294457:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788909105.294467:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019502336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909105.294503:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909105.294568:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019502336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909105.294576:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788909105.294729:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890510387b80 x1875807019502336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909105.294751:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019502336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788909105.861380:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909106.896683:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909107.911272:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909108.934477:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909109.381481:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788909109.382768:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019502464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788909109.383070:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909109.383355:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019502464 00000100:00100000:3.0:1788909109.383365:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019502464 00000100:00100000:3.0:1788909109.383484:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909109.383495:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019502464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909109.383563:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909109.383626:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019502464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909109.383632:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788909109.383977:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788909109.384015:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d421f80 x1875807019502464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909109.384038:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019502464:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788909109.391544:0:8807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788909109.853057:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909109.853384:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004793728 00000100:00100000:3.0:1788909109.853403:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004793728 00000100:00100000:3.0:1788909109.853518:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788909109.853534:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004793728:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909109.853650:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004793728:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 121us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909109.853660:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00080000:0.0:1788909109.856094:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909109.872645:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909109.872712:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909109.875652:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909109.875719:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004793984 00000100:00100000:0.0:1788909109.875732:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004793984 00000100:00100000:0.0:1788909109.875812:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004793856 00000100:00100000:0.0:1788909109.875815:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004793856 00000100:00100000:0.0:1788909109.875872:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788909109.875884:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004793984:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909109.875986:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004793984:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 104us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909109.875995:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788909109.876028:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1788909109.876034:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004793856:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909109.876060:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004793856:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909109.876066:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00080000:0.0:1788909109.876091:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788909109.876095:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909109.878791:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004793600 00000100:00100000:1.0:1788909109.878812:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004793600 00000100:00100000:1.0:1788909109.878911:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:1.0:1788909109.878926:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2349:x1875807004793600:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909109.879055:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2349:x1875807004793600:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 132us (6342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909109.879065:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 190 00010000:00010000:0.0:1788909109.957439:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909110.405529:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788909110.405558:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019502720:0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.405577:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019502848:0@lo:400:kworker.0 00000100:00100000:2.0:1788909110.405707:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019503232:0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.405916:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909110.405995:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019503360:0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.406028:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909110.406058:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788909110.406063:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019502976:0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.406089:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909110.406149:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019502848 00000100:00100000:0.0:1788909110.406159:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019502848 00000100:00100000:0.0:1788909110.406476:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019502976 00000100:00100000:0.0:1788909110.406481:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019502976 00000100:00100000:0.0:1788909110.406526:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788909110.406537:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019502848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.406627:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019502848:12345-0@lo:400:kworker.0 Request processed in 91us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909110.406635:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788909110.406665:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788909110.406672:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019502976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.406701:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019502976:12345-0@lo:400:kworker.0 Request processed in 30us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909110.406706:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788909110.406730:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019503360 00000100:00100000:0.0:1788909110.406733:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019503360 00000100:00100000:0.0:1788909110.406764:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788909110.406770:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019503360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.406805:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019503360:12345-0@lo:400:kworker.0 Request processed in 35us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909110.406812:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788909110.406840:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788909110.406845:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909110.406893:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019502976:0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.406906:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019502848:0@lo:400:kworker.0 00010000:00080000:0.0:1788909110.406919:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89051175ce00 x1875807019503360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909110.406932:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019503360:0@lo:400:kworker.0 00000100:00100000:3.0:1788909110.409391:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909110.409689:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019502720 00000100:00100000:0.0:1788909110.409701:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019502720 00000100:00100000:0.0:1788909110.409781:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788909110.409803:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019502720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.409885:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019502720:12345-0@lo:400:kworker.0 Request processed in 86us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909110.409895:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788909110.410662:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019502720:0@lo:400:kworker.0 00000100:00100000:3.0:1788909110.410682:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019502592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909110.410725:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909110.410792:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909110.410793:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019503104:0@lo:400:kworker.0 00000100:00100000:3.0:1788909110.410820:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909110.410861:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019502592 00000100:00100000:3.0:1788909110.410867:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019502592 00000100:00100000:3.0:1788909110.410908:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788909110.410916:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019502592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909110.410921:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019503232 00000100:00100000:2.0:1788909110.410925:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019503232 00000100:00100000:2.0:1788909110.410972:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788909110.410980:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019503232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909110.411027:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019503232:12345-0@lo:400:kworker.0 Request processed in 48us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909110.411034:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788909110.411090:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019503104 00000100:00100000:0.0:1788909110.411094:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019503104 00000100:00100000:0.0:1788909110.411142:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788909110.411151:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019503104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909110.411192:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019503104:12345-0@lo:400:kworker.0 Request processed in 43us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909110.411198:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788909110.411205:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788909110.411243:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890510387100 x1875807019503104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909110.411257:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019503104:0@lo:400:kworker.0 00000100:00100000:2.0:1788909110.411318:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019503232:0@lo:400:kworker.0 00002000:00000024:3.0:1788909110.412237:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909110.412342:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019502592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1424us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909110.412351:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788909110.412916:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d422680 x1875807019502592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909110.412952:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019502592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788909110.981540:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909112.006852:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909113.029873:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909114.057540:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788909114.461932:0:9052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing yml_node 00000100:00100000:2.0:1788909114.502357:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909114.503815:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019503488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788909114.503890:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909114.504029:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019503488 00000100:00100000:3.0:1788909114.504038:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019503488 00000100:00100000:3.0:1788909114.504105:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788909114.504140:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019503488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909114.504181:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909114.504231:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019503488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909114.504238:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788909114.504291:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcb3800 x1875807019503488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909114.504312:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019503488:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788909114.504365:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788909114.982040:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909114.982133:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909114.982202:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004794112 00000100:00100000:3.0:1788909114.982213:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004794112 00000100:00100000:3.0:1788909114.982287:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:3.0:1788909114.982299:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004794112:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909114.982378:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004794112:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 81us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909114.982387:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:1.0:1788909114.982574:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004794240 00000100:00100000:1.0:1788909114.982579:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004794240 00000100:00100000:1.0:1788909114.982631:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788909114.982655:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004794240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909114.982696:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004794240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 46us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909114.982703:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00080000:3.0:1788909114.982905:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909114.982984:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909114.983016:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909114.983038:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004794368 00000100:00100000:1.0:1788909114.983042:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004794368 00000100:00100000:1.0:1788909114.983075:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004794496 00000100:00100000:1.0:1788909114.983078:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004794496 00000100:00100000:1.0:1788909114.983100:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788909114.983141:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2346:x1875807004794368:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1788909114.983176:0:6673:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d55b9 00000100:00080000:1.0:1788909114.983188:0:6673:0:(import.c:65:import_set_state_nolock()) ffff89052dc1d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788909114.983258:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788909114.983695:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+2:2346:x1875807004794368:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 586us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909114.983704:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788909114.983723:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788909114.983732:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2346:x1875807004794496:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1788909114.983755:0:6673:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d55c0 00000100:00080000:1.0:1788909114.983762:0:6673:0:(import.c:65:import_set_state_nolock()) ffff890537b23800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788909114.983789:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788909114.983982:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+2:2346:x1875807004794496:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 252us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909114.983990:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:1.0:1788909114.984021:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788909114.984024:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788909114.984100:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909114.984106:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909115.081724:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909115.525578:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019503616:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.525661:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909115.525706:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019504128:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.525747:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909115.525777:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788909115.525783:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019503744:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.525805:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909115.525822:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019504256:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.525844:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909115.525880:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019503872:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.525903:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909115.525921:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788909115.525926:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019504000:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.525947:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909115.525978:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019503616 00000100:00100000:0.0:1788909115.525985:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019503616 00000100:00100000:0.0:1788909115.526030:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788909115.526039:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019503616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.526085:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019503616:12345-0@lo:400:kworker.0 Request processed in 47us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909115.526092:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788909115.526146:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019504128 00000100:00100000:0.0:1788909115.526151:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019504128 00000100:00100000:0.0:1788909115.526181:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019503744 00000100:00100000:0.0:1788909115.526184:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019503744 00000100:00100000:0.0:1788909115.526194:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019503872 00000100:00100000:0.0:1788909115.526196:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019503872 00000100:00100000:0.0:1788909115.526208:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788909115.526213:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019504128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.526256:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019504128:12345-0@lo:400:kworker.0 Request processed in 42us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909115.526261:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788909115.526274:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788909115.526279:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019503744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.526299:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019503744:12345-0@lo:400:kworker.0 Request processed in 21us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909115.526313:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788909115.526327:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788909115.526332:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019503872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.526358:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019503872:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909115.526363:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788909115.526383:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019504256 00000100:00100000:0.0:1788909115.526386:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019504256 00000100:00100000:0.0:1788909115.526406:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019504000 00000100:00100000:0.0:1788909115.526408:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019504000 00000100:00100000:0.0:1788909115.526423:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788909115.526428:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019504256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.526453:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019504256:12345-0@lo:400:kworker.0 Request processed in 25us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909115.526459:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788909115.526469:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788909115.526473:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019504000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.526506:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019504000:12345-0@lo:400:kworker.0 Request processed in 32us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909115.526512:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788909115.526553:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019503744:0@lo:400:kworker.0 00010000:00080000:0.0:1788909115.526564:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890510385c00 x1875807019504256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909115.526574:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019504256:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.526581:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019503616:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.526597:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019504128:0@lo:400:kworker.0 00000100:00080000:0.0:1788909115.526623:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788909115.526627:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788909115.526642:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890510385f80 x1875807019504000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909115.526651:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019504000:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.526659:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019503872:0@lo:400:kworker.0 00000100:00100000:0.0:1788909115.528022:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019504384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909115.528074:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909115.528136:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019504384 00000100:00100000:0.0:1788909115.528141:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019504384 00000100:00100000:0.0:1788909115.528178:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788909115.528185:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019504384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788909115.528216:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788909115.528267:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019504384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909115.528273:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788909115.528310:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890403558a80 x1875807019504384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909115.528328:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019504384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788909116.101524:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909117.125619:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788909117.629599:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:2.0:1788909117.629609:0:6701:0:(genops.c:885:class_export_put()) final put ffff89052dc1e800/9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:2.0:1788909117.629636:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff89052dc1e800/9a693284-9812-4b47-95bb-9bc33a7c4ef4 for lustre-OST0000 00000020:00000080:2.0:1788909117.629681:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89052dc1d000 for lustre-OST0000 00010000:00010000:0.0:1788909118.149322:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788909118.494736:0:9245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.86 00000001:00100000:0.0:1788909119.175078:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:0.0:1788909119.175091:0:7643:0:(genops.c:885:class_export_put()) final put ffff890537b21800/9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:1.0:1788909119.175271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff890537b21800/9a693284-9812-4b47-95bb-9bc33a7c4ef4 for lustre-OST0001 00000020:00000080:1.0:1788909119.175334:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff890537b23800 for lustre-OST0001 00010000:00010000:1.0:1788909119.184297:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909119.622804:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019504512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788909119.622925:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909119.623058:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019504512 00000100:00100000:1.0:1788909119.623068:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019504512 00000100:00100000:1.0:1788909119.623236:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788909119.623250:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019504512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788909119.623309:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909119.623362:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019504512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909119.623370:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788909119.623450:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcb1500 x1875807019504512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909119.623470:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019504512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788909119.623696:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909120.092411:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909120.092492:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909120.092600:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004794624 00000100:00100000:2.0:1788909120.092615:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004794624 00000100:00100000:2.0:1788909120.092682:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:2.0:1788909120.092693:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2349:x1875807004794624:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909120.092803:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2349:x1875807004794624:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 112us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909120.092812:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:0.0:1788909120.092885:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004794752 00000100:00100000:0.0:1788909120.093071:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004794752 00000100:00100000:0.0:1788909120.093244:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:0.0:1788909120.093254:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004794752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909120.093297:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004794752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 45us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909120.093303:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00080000:2.0:1788909120.094207:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788909120.197314:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909120.646305:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019504640:0@lo:400:kworker.0 00000100:00100000:1.0:1788909120.646367:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019504768:0@lo:400:kworker.0 00000100:00100000:1.0:1788909120.646410:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909120.646410:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909120.646548:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019505152:0@lo:400:kworker.0 00000100:00100000:0.0:1788909120.646579:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909120.646592:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019504896:0@lo:400:kworker.0 00000100:00100000:0.0:1788909120.646623:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019504768 00000100:00100000:0.0:1788909120.646633:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019504768 00000100:00100000:2.0:1788909120.646653:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909120.646686:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788909120.646693:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019505152 00000100:00100000:2.0:1788909120.646695:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019505024:0@lo:400:kworker.0 00000100:00100000:0.0:1788909120.646697:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019505152 00000100:00100000:0.0:1788909120.646731:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019504896 00000100:00100000:2.0:1788909120.646737:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909120.646737:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019504896 00000100:00100000:0.0:1788909120.646761:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788909120.646772:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019504768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909120.646784:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788909120.646795:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019505152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909120.646838:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019504768:12345-0@lo:400:kworker.0 Request processed in 66us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909120.646847:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788909120.646852:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019505152:12345-0@lo:400:kworker.0 Request processed in 59us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909120.646860:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788909120.646876:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788909120.647233:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019505024 00000100:00100000:3.0:1788909120.647239:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019505024 00000100:00100000:3.0:1788909120.647271:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788909120.647278:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019505024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909120.647555:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019505024:12345-0@lo:400:kworker.0 Request processed in 277us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909120.647562:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788909120.647583:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909120.647623:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019505152:0@lo:400:kworker.0 00000100:00100000:0.0:1788909120.648807:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019504896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909120.649563:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019504768:0@lo:400:kworker.0 00000100:00100000:1.0:1788909120.649582:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019505280:0@lo:400:kworker.0 00000100:00100000:1.0:1788909120.649641:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909120.649903:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019504640 00000100:00100000:1.0:1788909120.649914:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019504640 00000100:00100000:1.0:1788909120.649984:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788909120.649994:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019504640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909120.650042:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019504640:12345-0@lo:400:kworker.0 Request processed in 49us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909120.650069:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788909120.650152:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019505280 00000100:00100000:1.0:1788909120.650156:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019505280 00000100:00100000:1.0:1788909120.650199:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788909120.650299:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019505280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909120.650345:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019505280:12345-0@lo:400:kworker.0 Request processed in 139us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909120.650352:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788909120.650370:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788909120.650400:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcb0000 x1875807019505280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909120.650411:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788909120.650414:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019505280:0@lo:400:kworker.0 00000100:00100000:2.0:1788909120.650429:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019505408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909120.650475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788909120.650546:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcb2680 x1875807019505024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909120.650560:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019505024:0@lo:400:kworker.0 00000100:00100000:1.0:1788909120.650560:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019505408 00000100:00100000:1.0:1788909120.650567:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019505408 00000100:00100000:2.0:1788909120.650583:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019504896:0@lo:400:kworker.0 00000100:00100000:1.0:1788909120.650605:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788909120.650614:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019505408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909120.650649:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909120.650690:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019505408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909120.650696:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788909120.650728:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d421880 x1875807019505408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909120.650745:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019505408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909120.651455:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019504896:12345-0@lo:400:kworker.0 Request processed in 2657us (4798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909120.651465:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788909120.651906:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019504640:0@lo:400:kworker.0 00000001:02000400:0.0:1788909120.810886:0:9342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.86 00010000:00010000:0.0:1788909121.221381:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909122.248661:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788909123.008762:0:9440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.86 00010000:00010000:0.0:1788909123.269538:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909124.294540:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788909124.536801:0:9488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 19:12:02 EDT 2026 00000100:00100000:1.0:1788909124.743661:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019505536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909124.743760:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909124.744772:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019505536 00000100:00100000:1.0:1788909124.744782:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019505536 00000100:00100000:1.0:1788909124.744850:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788909124.744861:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019505536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788909124.744911:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909124.744999:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019505536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909124.745008:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788909124.745032:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788909124.745081:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcb0000 x1875807019505536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909124.745126:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019505536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909125.213457:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909125.213543:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909125.213626:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004795008 00000100:00100000:2.0:1788909125.213638:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004795008 00000100:00100000:2.0:1788909125.213740:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788909125.213767:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004795008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909125.213951:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004795008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 187us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909125.213960:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00080000:1.0:1788909125.214353:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909125.218210:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004794880 00000100:00100000:3.0:1788909125.218229:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004794880 00000100:00100000:2.0:1788909125.218418:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:2.0:1788909125.218430:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004794880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909125.218565:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004794880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 135us (5116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909125.218574:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00010000:00010000:0.0:1788909125.317437:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909125.767377:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788909125.767402:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019505664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909125.767482:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909125.767553:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019505664 00000100:00100000:1.0:1788909125.767561:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019505664 00000100:00100000:1.0:1788909125.767617:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788909125.767626:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019505664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909125.767665:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909125.767721:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019505664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909125.767728:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788909125.767749:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788909125.767779:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcb3800 x1875807019505664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909125.767798:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019505664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909125.768490:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019505920:0@lo:400:kworker.0 00000100:00100000:2.0:1788909125.768532:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909125.768557:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909125.768563:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019506048:0@lo:400:kworker.0 00000100:00100000:2.0:1788909125.768586:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909125.768622:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019505920 00000100:00100000:2.0:1788909125.768627:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019505920 00000100:00100000:2.0:1788909125.768657:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019506048 00000100:00100000:2.0:1788909125.768660:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019506048 00000100:00100000:2.0:1788909125.768686:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788909125.768693:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019505920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909125.768733:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019505920:12345-0@lo:400:kworker.0 Request processed in 40us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909125.768739:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788909125.768753:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788909125.768760:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019506048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909125.768800:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019506048:12345-0@lo:400:kworker.0 Request processed in 41us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909125.768807:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788909125.768841:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019506048:0@lo:400:kworker.0 00000100:00100000:2.0:1788909125.768851:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019505920:0@lo:400:kworker.0 00000100:00100000:3.0:1788909125.769048:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019506176:0@lo:400:kworker.0 00000100:00100000:3.0:1788909125.769083:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909125.769105:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788909125.769132:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019505792:0@lo:400:kworker.0 00000100:00100000:3.0:1788909125.769160:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909125.769184:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019506304:0@lo:400:kworker.0 00000100:00100000:3.0:1788909125.769202:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909125.769418:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019506176 00000100:00100000:3.0:1788909125.769423:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019506176 00000100:00100000:3.0:1788909125.769457:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788909125.769464:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019506176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909125.769506:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019506176:12345-0@lo:400:kworker.0 Request processed in 42us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909125.769513:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788909125.769545:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019505792 00000100:00100000:3.0:1788909125.769549:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019505792 00000100:00100000:3.0:1788909125.769575:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788909125.769581:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019505792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909125.769609:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019505792:12345-0@lo:400:kworker.0 Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909125.769649:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788909125.769671:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019506304 00000100:00100000:3.0:1788909125.769674:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019506304 00000100:00100000:3.0:1788909125.769695:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788909125.769700:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019506304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909125.769726:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019506304:12345-0@lo:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909125.769731:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788909125.769762:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019505792:0@lo:400:kworker.0 00000100:00100000:3.0:1788909125.769773:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019506304:0@lo:400:kworker.0 00010000:00080000:3.0:1788909125.769787:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d425c00 x1875807019506176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909125.769796:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019506176:0@lo:400:kworker.0 00000100:00080000:1.0:1788909125.769932:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788909126.342401:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909127.366641:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909128.390445:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909129.414378:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909129.863415:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019506432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909129.863524:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909129.863638:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019506432 00000100:00100000:3.0:1788909129.863648:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019506432 00000100:00100000:3.0:1788909129.863875:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788909129.863889:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019506432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909129.863947:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909129.864017:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019506432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909129.864028:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788909129.864058:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788909129.864102:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d423b80 x1875807019506432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909129.864340:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019506432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788909130.336409:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909130.336475:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909130.336607:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004795136 00000100:00100000:1.0:1788909130.336623:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004795136 00000100:00100000:1.0:1788909130.336710:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:1.0:1788909130.336724:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004795136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909130.336830:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004795136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 109us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909130.336840:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:3.0:1788909130.346270:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004795264 00000100:00100000:3.0:1788909130.346296:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004795264 00000100:00100000:3.0:1788909130.346516:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788909130.346531:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004795264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909130.346658:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004795264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 132us (10183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909130.346667:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00080000:1.0:1788909130.353282:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788909130.445783:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909130.885321:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788909130.885358:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019506560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909130.885455:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909130.885539:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019506560 00000100:00100000:1.0:1788909130.885549:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019506560 00000100:00100000:1.0:1788909130.885643:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788909130.885654:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019506560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909130.885706:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909130.885766:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019506560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909130.885792:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788909130.885819:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788909130.885857:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcb3800 x1875807019506560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909130.885882:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019506560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909130.885909:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788909130.885919:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019506688:0@lo:400:kworker.0 00000100:00100000:1.0:1788909130.885972:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909130.885974:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019507200:0@lo:400:kworker.0 00000100:00100000:1.0:1788909130.885999:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019506816:0@lo:400:kworker.0 00000100:00100000:2.0:1788909130.886013:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909130.886028:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019506688 00000100:00100000:1.0:1788909130.886032:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019506688 00000100:00100000:2.0:1788909130.886052:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019507200 00000100:00100000:2.0:1788909130.886055:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019507200 00000100:00100000:1.0:1788909130.886058:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788909130.886064:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019506688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909130.886091:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788909130.886096:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019506688:12345-0@lo:400:kworker.0 Request processed in 33us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909130.886098:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019507200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909130.886103:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788909130.886151:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909130.886152:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019507200:12345-0@lo:400:kworker.0 Request processed in 55us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909130.886159:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788909130.886170:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019506816 00000100:00100000:2.0:1788909130.886172:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019506816 00000100:00100000:1.0:1788909130.886175:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019506688:0@lo:400:kworker.0 00000100:00100000:2.0:1788909130.886193:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788909130.886198:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019506816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909130.886215:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019506944:0@lo:400:kworker.0 00000100:00100000:1.0:1788909130.886241:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909130.886258:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788909130.886263:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019507072:0@lo:400:kworker.0 00000100:00100000:1.0:1788909130.886289:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909130.886298:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019506816:12345-0@lo:400:kworker.0 Request processed in 100us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909130.886305:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788909130.886313:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019507072 00000100:00100000:1.0:1788909130.886322:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019507072 00000100:00100000:2.0:1788909130.886323:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019506944 00000100:00100000:2.0:1788909130.886325:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019506944 00000100:00100000:1.0:1788909130.886352:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788909130.886359:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019507072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909130.886394:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019507072:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909130.886401:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788909130.886430:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d426d80 x1875807019507072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909130.886440:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019507072:0@lo:400:kworker.0 00000100:00100000:2.0:1788909130.886564:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788909130.886572:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019506944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909130.886618:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019506944:12345-0@lo:400:kworker.0 Request processed in 48us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909130.886624:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788909130.886648:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909130.886667:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019507200:0@lo:400:kworker.0 00000100:00100000:3.0:1788909130.886687:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019506944:0@lo:400:kworker.0 00000100:00100000:2.0:1788909130.886687:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019506816:0@lo:400:kworker.0 00010000:00010000:0.0:1788909131.465679:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909132.485312:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909133.511294:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909134.533783:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909134.982407:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788909134.982444:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019507328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909134.982567:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909134.982752:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019507328 00000100:00100000:1.0:1788909134.982765:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019507328 00000100:00100000:1.0:1788909134.982877:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788909134.982891:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019507328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788909134.982956:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909134.983021:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019507328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909134.983029:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788909134.983098:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d423b80 x1875807019507328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909134.983147:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019507328:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788909134.983949:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788909135.450870:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909135.450931:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909135.451029:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004795392 00000100:00100000:3.0:1788909135.451043:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004795392 00000100:00100000:1.0:1788909135.451159:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004795520 00000100:00100000:3.0:1788909135.451163:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:1.0:1788909135.451164:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004795520 00000100:00100000:3.0:1788909135.451177:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004795392:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909135.451220:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1788909135.451228:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004795520:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909135.451276:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004795520:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 49us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909135.451295:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00080000:1.0:1788909135.451321:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909135.452629:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2347:x1875807004795392:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1445us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909135.452653:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 200 00010000:00010000:0.0:1788909135.564408:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909136.005372:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019507456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909136.005457:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909136.007160:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019507456 00000100:00100000:0.0:1788909136.007174:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019507456 00000100:00100000:0.0:1788909136.007248:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788909136.007260:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019507456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788909136.007305:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788909136.007429:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788909136.007814:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019507456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 555us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909136.007822:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788909136.008101:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019507584:0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008163:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909136.008193:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019508096:0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008217:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909136.008237:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788909136.008243:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019507968:0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008266:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909136.008294:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019507712:0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008317:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909136.008335:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909136.008340:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019507840:0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008360:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909136.008387:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019507584 00000100:00100000:1.0:1788909136.008392:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019507584 00000100:00100000:1.0:1788909136.008423:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788909136.008431:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019507584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008469:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019507584:12345-0@lo:400:kworker.0 Request processed in 39us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909136.008476:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788909136.008503:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019507968 00000100:00100000:1.0:1788909136.008507:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019507968 00000100:00100000:1.0:1788909136.008540:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788909136.008547:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019507968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008585:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019507968:12345-0@lo:400:kworker.0 Request processed in 39us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909136.008592:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788909136.008610:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019508096 00000100:00100000:1.0:1788909136.008614:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019508096 00000100:00100000:1.0:1788909136.008636:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019507712 00000100:00100000:1.0:1788909136.008639:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019507712 00000100:00100000:1.0:1788909136.008650:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019507840 00000100:00100000:1.0:1788909136.008652:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019507840 00000100:00100000:1.0:1788909136.008666:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788909136.008671:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019508096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008699:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019508096:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909136.008705:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788909136.008716:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788909136.008722:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019507712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008747:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019507712:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909136.008753:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788909136.008763:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788909136.008769:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019507840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008809:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019507840:12345-0@lo:400:kworker.0 Request processed in 40us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909136.008815:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788909136.008862:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d56ca80 x1875807019507968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909136.008889:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019507968:0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008901:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019507584:0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008911:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019508096:0@lo:400:kworker.0 00000100:00080000:1.0:1788909136.008935:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788909136.008939:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909136.008955:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019507840:0@lo:400:kworker.0 00000100:00100000:1.0:1788909136.008963:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019507712:0@lo:400:kworker.0 00010000:00080000:2.0:1788909136.009267:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052dcb1f80 x1875807019507456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909136.009285:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019507456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788909136.581309:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909137.615054:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909138.629541:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788909139.320686:0:10118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:12:17 (1788909137) === 00010000:00010000:1.0:1788909139.658659:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909139.719340:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.722149:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004795648 00000100:00100000:2.0:1788909139.722176:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004795648 00000100:00100000:2.0:1788909139.722292:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:2.0:1788909139.722305:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:8135:x1875807004795648:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788909139.722328:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909139.722352:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc10400/0x733cfdd8721d5684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a444b4 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909139.722413:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10400/0x733cfdd8721d5684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444b4 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909139.722953:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc10400/0x733cfdd8721d5684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444b4 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909139.722968:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10400, rc 0) 00000100:00100000:2.0:1788909139.723140:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8135:x1875807004795648:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 808us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909139.723150:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:1.0:1788909139.729212:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.729329:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004795776 00000100:00100000:2.0:1788909139.729342:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004795776 00000100:00100000:2.0:1788909139.729428:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:2.0:1788909139.729440:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8135:x1875807004795776:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788909139.729930:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8135:x1875807004795776:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 490us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909139.729941:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:1.0:1788909139.737296:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.737414:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004795904 00000100:00100000:2.0:1788909139.737628:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004795904 00000100:00100000:2.0:1788909139.738712:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:2.0:1788909139.738735:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8135:x1875807004795904:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788909139.739141:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8135:x1875807004795904:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 415us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909139.739151:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:3.0:1788909139.748805:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909139.748926:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004796032 00000100:00100000:1.0:1788909139.748943:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004796032 00000100:00100000:1.0:1788909139.749343:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:1.0:1788909139.749360:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8139:x1875807004796032:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788909139.751221:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8139:x1875807004796032:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 1839us (2409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909139.751240:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:1.0:1788909139.772436:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.773431:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004796160 00000100:00100000:2.0:1788909139.773470:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004796160 00000100:00100000:2.0:1788909139.773566:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:2.0:1788909139.773581:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8139:x1875807004796160:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788909139.774180:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8139:x1875807004796160:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 601us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909139.774191:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:1.0:1788909139.786797:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909139.787006:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004796288 00000100:00100000:0.0:1788909139.787040:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004796288 00000100:00100000:0.0:1788909139.787151:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:0.0:1788909139.787164:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:8135:x1875807004796288:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788909139.787189:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909139.787214:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9c000/0x733cfdd8721d568b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a444de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909139.787251:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9c000/0x733cfdd8721d568b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444de expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909139.787265:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9c000/0x733cfdd8721d568b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444de expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909139.787276:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9c000, rc 0) 00000100:00100000:0.0:1788909139.787368:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:8135:x1875807004796288:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 206us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909139.787376:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:3.0:1788909139.797660:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909139.797991:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004796416 00000100:00100000:0.0:1788909139.798006:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004796416 00000100:00100000:0.0:1788909139.798082:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:0.0:1788909139.798095:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:8135:x1875807004796416:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788909139.798440:0:5817:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788909139.798473:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788909139.798478:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788909139.798482:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788909139.798484:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788909139.803228:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:8135:x1875807004796416:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 5106us (5556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909139.803271:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:1.0:1788909139.806691:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.806807:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004796544 00000100:00100000:2.0:1788909139.806822:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004796544 00000100:00100000:2.0:1788909139.806988:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:2.0:1788909139.807012:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:8135:x1875807004796544:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788909139.807037:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909139.807062:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a444e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909139.807103:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444e5 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909139.807150:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444e5 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909139.807162:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10200, rc 0) 00000100:00100000:2.0:1788909139.807259:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:8135:x1875807004796544:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 260us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909139.807268:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:2.0:1788909139.810711:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909139.810832:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004796672 00000100:00100000:0.0:1788909139.810847:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004796672 00000100:00100000:0.0:1788909139.810925:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:0.0:1788909139.810937:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:8135:x1875807004796672:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788909139.811370:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:8135:x1875807004796672:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 434us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909139.811678:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:3.0:1788909139.813439:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.813513:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004796800 00000100:00100000:2.0:1788909139.813526:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004796800 00000100:00100000:2.0:1788909139.813614:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:2.0:1788909139.813627:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:8135:x1875807004796800:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788909139.813969:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:8135:x1875807004796800:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 343us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909139.813979:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:2.0:1788909139.819363:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909139.819915:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004796928 00000100:00100000:1.0:1788909139.819933:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004796928 00000100:00100000:1.0:1788909139.820074:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:1.0:1788909139.820089:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:8143:x1875807004796928:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788909139.820536:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:8143:x1875807004796928:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 449us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909139.820555:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:2.0:1788909139.824237:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909139.824622:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004797056 00000100:00100000:0.0:1788909139.824636:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004797056 00000100:00100000:0.0:1788909139.824843:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:0.0:1788909139.824857:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:8143:x1875807004797056:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788909139.825368:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:8143:x1875807004797056:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 512us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909139.825377:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:3.0:1788909139.834639:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.835526:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909139.835919:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004797184 00000100:00100000:1.0:1788909139.835937:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004797184 00000100:00100000:1.0:1788909139.836000:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004797568 00000100:00100000:1.0:1788909139.836004:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004797568 00000100:00100000:1.0:1788909139.836131:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788909139.836146:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004797568:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909139.836260:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004797568:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 117us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909139.836269:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788909139.836295:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788909139.836300:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1875807004797184:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788909139.836332:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ae3d4805-3977-4f79-88af-684dce002b2f@192.168.204.54@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1788909139.836392:0:5823:0:(genops.c:1385:class_connect()) connect: client ae3d4805-3977-4f79-88af-684dce002b2f, cookie 0x733cfdd8721d5699 00000004:00100000:1.0:1788909139.836439:0:5823:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788909139.837723:0:5823:0:(import.c:65:import_set_state_nolock()) ffff89050852c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788909139.837810:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+6:2346:x1875807004797184:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 1506us (3188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909139.837820:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:0.0:1788909139.840916:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909139.841043:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.841149:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909139.841312:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004797440 00000100:00100000:0.0:1788909139.841312:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004797312 00000100:00100000:3.0:1788909139.841325:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004797440 00000100:00100000:0.0:1788909139.841325:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004797312 00000100:00100000:0.0:1788909139.841403:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788909139.841416:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+7:0:x1875807004797312:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788909139.841598:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788909139.841607:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788909139.841614:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+7:8135:x1875807004797440:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788909139.841629:0:5824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788909139.841743:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+7:8135:x1875807004797440:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 128us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909139.841743:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+7:0:x1875807004797312:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 328us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909139.841751:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788909139.841768:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:1.0:1788909139.841937:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909139.847604:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909139.847863:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004797696 00000100:00100000:1.0:1788909139.847876:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004797696 00000100:00100000:1.0:1788909139.847952:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788909139.847964:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+6:8135:x1875807004797696:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788909139.848085:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+6:8135:x1875807004797696:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 123us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909139.848156:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788909139.855076:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909139.855356:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004798080 00000100:00100000:3.0:1788909139.855382:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004798080 00000100:00100000:3.0:1788909139.855492:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788909139.855629:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae3d4805-3977-4f79-88af-684dce002b2f+6:8135:x1875807004798080:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788909139.858171:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788909139.861241:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.861291:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae3d4805-3977-4f79-88af-684dce002b2f+6:8135:x1875807004798080:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 3816us (4381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909139.861319:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:0.0:1788909139.861379:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909139.861430:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004797824 00000100:00100000:2.0:1788909139.861444:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004797824 00000100:00100000:1.0:1788909139.861527:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004797952 00000100:00100000:1.0:1788909139.861533:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004797952 00000100:00100000:1.0:1788909139.861564:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1788909139.861574:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875807004797824:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788909139.861617:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ae3d4805-3977-4f79-88af-684dce002b2f@192.168.204.54@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1788909139.861674:0:6675:0:(genops.c:1385:class_connect()) connect: client ae3d4805-3977-4f79-88af-684dce002b2f, cookie 0x733cfdd8721d56a0 00002000:00100000:1.0:1788909139.861692:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ae3d4805-3977-4f79-88af-684dce002b2f/ffff890508529000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788909139.861724:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788909139.862030:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788909139.862069:0:6675:0:(import.c:65:import_set_state_nolock()) ffff890508529800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788909139.862094:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788909139.862101:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875807004797952:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788909139.862193:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ae3d4805-3977-4f79-88af-684dce002b2f@192.168.204.54@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1788909139.862216:0:6676:0:(genops.c:1385:class_connect()) connect: client ae3d4805-3977-4f79-88af-684dce002b2f, cookie 0x733cfdd8721d56a7 00002000:00100000:2.0:1788909139.862223:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ae3d4805-3977-4f79-88af-684dce002b2f/ffff89052d8da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788909139.862241:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788909139.862349:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae3d4805-3977-4f79-88af-684dce002b2f+6:2346:x1875807004797824:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 774us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909139.862358:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00002000:00080000:2.0:1788909139.862629:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788909139.862656:0:6676:0:(import.c:65:import_set_state_nolock()) ffff89052d8dd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788909139.862701:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae3d4805-3977-4f79-88af-684dce002b2f+6:2346:x1875807004797952:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 600us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909139.862708:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788909140.101478:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019508224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909140.101611:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909140.102227:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019508224 00000100:00100000:2.0:1788909140.102242:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019508224 00000100:00100000:2.0:1788909140.102341:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788909140.102353:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019508224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788909140.102385:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788909140.102631:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788909140.108817:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019508224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6442us (7181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909140.109223:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788909140.113072:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d423800 x1875807019508224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909140.113350:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019508224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788909140.677341:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909141.125783:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019508352:0@lo:400:kworker.0 00000100:00100000:3.0:1788909141.125880:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909141.126077:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019508480:0@lo:400:kworker.0 00000100:00100000:1.0:1788909141.126306:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909141.126341:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788909141.126360:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040355a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019508608:0@lo:400:kworker.0 00000100:00100000:1.0:1788909141.126386:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909141.126414:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019508736:0@lo:400:kworker.0 00000100:00100000:1.0:1788909141.126442:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909141.126503:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019508480 00000100:00100000:1.0:1788909141.126514:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019508480 00000100:00100000:1.0:1788909141.126570:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019508608 00000100:00100000:1.0:1788909141.126573:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019508608 00000100:00100000:1.0:1788909141.126608:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788909141.126617:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019508480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909141.126681:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019508480:12345-0@lo:400:kworker.0 Request processed in 64us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909141.126689:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788909141.126707:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788909141.126714:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019508608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909141.126754:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019508608:12345-0@lo:400:kworker.0 Request processed in 41us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909141.126761:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788909141.126813:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040355a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019508608:0@lo:400:kworker.0 00000100:00100000:1.0:1788909141.126825:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019508480:0@lo:400:kworker.0 00000100:00100000:1.0:1788909141.126859:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019508736 00000100:00100000:1.0:1788909141.126862:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019508736 00000100:00100000:1.0:1788909141.126891:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788909141.126898:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019508736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909141.126933:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019508736:12345-0@lo:400:kworker.0 Request processed in 36us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909141.126949:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788909141.126981:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890403558380 x1875807019508736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909141.126992:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019508736:0@lo:400:kworker.0 00000100:00080000:1.0:1788909141.127013:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909141.131482:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019508864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909141.131585:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909141.131662:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019508352 00000100:00100000:3.0:1788909141.131673:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019508352 00000100:00100000:3.0:1788909141.131747:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788909141.131767:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019508352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909141.131831:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019508352:12345-0@lo:400:kworker.0 Request processed in 66us (5951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909141.131839:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788909141.131891:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019508864 00000100:00100000:3.0:1788909141.131895:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019508864 00000100:00100000:3.0:1788909141.131937:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788909141.131944:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019508864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788909141.131983:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909141.132021:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019508864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909141.132028:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788909141.132055:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788909141.132087:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d56e680 x1875807019508864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909141.132135:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019508864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909141.132150:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019508352:0@lo:400:kworker.0 00000100:00100000:0.0:1788909141.132372:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788909141.132384:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019508992:0@lo:400:kworker.0 00000100:00100000:0.0:1788909141.132425:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909141.132479:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019508992 00000100:00100000:0.0:1788909141.132483:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019508992 00000100:00100000:0.0:1788909141.132528:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788909141.132536:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019508992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909141.132579:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019508992:12345-0@lo:400:kworker.0 Request processed in 43us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909141.132585:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788909141.132623:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019508992:0@lo:400:kworker.0 00000100:00080000:0.0:1788909141.132637:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788909141.701353:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909142.727289:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788909143.225471:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae3d4805-3977-4f79-88af-684dce002b2f 00010000:00010000:1.0:1788909143.749671:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788909144.773251:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae3d4805-3977-4f79-88af-684dce002b2f 00010000:00010000:1.0:1788909144.776402:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788909144.783818:0:10315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:0.0:1788909144.806742:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae3d4805-3977-4f79-88af-684dce002b2f 00000100:00100000:3.0:1788909145.186313:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909145.186388:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909145.186425:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909145.186472:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909145.186506:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909145.186551:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004798464 00000100:00100000:3.0:1788909145.186565:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004798464 00000100:00100000:1.0:1788909145.186568:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004798336 00000100:00100000:1.0:1788909145.186585:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004798336 00000100:00100000:3.0:1788909145.186670:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1788909145.186748:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004798208 00000100:00100000:0.0:1788909145.186754:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004798208 00000100:00100000:0.0:1788909145.186792:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:0.0:1788909145.186803:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2350:x1875807004798208:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909145.186893:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2350:x1875807004798208:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 91us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909145.186901:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:3.0:1788909145.186981:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004798464:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909145.187019:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004798464:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 41us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909145.187084:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004798720 00000100:00100000:2.0:1788909145.187088:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004798720 00000100:00100000:2.0:1788909145.187163:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004798592 00000100:00100000:2.0:1788909145.187166:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004798592 00000100:00100000:2.0:1788909145.187191:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788909145.187199:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004798720:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909145.187230:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004798720:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909145.187237:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788909145.187251:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1788909145.187258:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004798592:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909145.187282:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004798592:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909145.187297:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1788909145.190527:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1788909145.190557:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004798336:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909145.190639:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004798336:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 98us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909145.190648:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00080000:0.0:1788909145.190887:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788909145.190898:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788909145.190902:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909145.191764:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1788909145.224156:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019509120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788909145.224231:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909145.224416:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019509120 00000100:00100000:1.0:1788909145.224426:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019509120 00000100:00080000:2.0:1788909145.224483:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909145.224504:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788909145.224517:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019509120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788909145.224556:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909145.224913:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019509120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 397us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909145.224922:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788909145.224984:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d421880 x1875807019509120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909145.225005:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019509120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788909145.797351:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909146.246391:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019509248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909146.246473:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909146.246938:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019509248 00000100:00100000:3.0:1788909146.246950:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019509248 00000100:00100000:3.0:1788909146.247014:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788909146.247023:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019509248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788909146.247062:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909146.247141:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019509248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909146.247150:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788909146.247185:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788909146.247212:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d56c380 x1875807019509248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909146.247232:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019509248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909146.254912:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019509504:0@lo:400:kworker.0 00000100:00100000:1.0:1788909146.255015:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909146.255070:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788909146.255076:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019509632:0@lo:400:kworker.0 00000100:00100000:1.0:1788909146.255104:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909146.255313:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019509376:0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.255365:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909146.255398:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019509888:0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.255426:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909146.255444:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788909146.255449:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019509760:0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.255488:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909146.255522:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019509376 00000100:00100000:3.0:1788909146.255530:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019509376 00000100:00100000:3.0:1788909146.255577:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788909146.255586:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019509376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.255654:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019509376:12345-0@lo:400:kworker.0 Request processed in 69us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909146.255664:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788909146.255701:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019509504 00000100:00100000:3.0:1788909146.255705:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019509504 00000100:00100000:3.0:1788909146.255731:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019509632 00000100:00100000:3.0:1788909146.255735:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019509632 00000100:00100000:3.0:1788909146.255757:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019509888 00000100:00100000:3.0:1788909146.255760:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019509888 00000100:00100000:3.0:1788909146.255791:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788909146.255797:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019509504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.255835:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019509504:12345-0@lo:400:kworker.0 Request processed in 38us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909146.255841:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788909146.255852:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788909146.255858:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019509632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.255881:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019509632:12345-0@lo:400:kworker.0 Request processed in 24us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909146.255886:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788909146.255896:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788909146.255900:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019509888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.255923:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019509888:12345-0@lo:400:kworker.0 Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909146.255936:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788909146.255956:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019509760 00000100:00100000:3.0:1788909146.255960:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019509760 00000100:00100000:3.0:1788909146.255987:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788909146.255993:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019509760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.256023:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019509760:12345-0@lo:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909146.256028:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788909146.256054:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788909146.256086:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d56ce00 x1875807019509760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909146.256101:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019509760:0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.256135:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019509376:0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.256145:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019509888:0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.256225:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019509632:0@lo:400:kworker.0 00000100:00100000:3.0:1788909146.256235:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019509504:0@lo:400:kworker.0 00010000:00010000:1.0:1788909146.821411:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909147.846261:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909148.869317:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909149.893923:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909150.301982:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909150.302032:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909150.302077:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909150.302089:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004799232 00000100:00100000:1.0:1788909150.302104:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909150.302140:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004799232 00000100:00100000:1.0:1788909150.302167:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909150.302208:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004798976 00000100:00100000:1.0:1788909150.302214:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004798976 00000100:00100000:3.0:1788909150.302240:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004799360 00000100:00100000:3.0:1788909150.302246:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004799360 00000100:00100000:1.0:1788909150.302264:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004799104 00000100:00100000:1.0:1788909150.302269:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004799104 00000100:00100000:3.0:1788909150.302305:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1788909150.302311:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1788909150.302323:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799232:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909150.302325:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004798976:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909150.302485:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004798976:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 164us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909150.302494:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788909150.302517:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1788909150.302524:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799104:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909150.302648:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799232:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 331us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909150.302691:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1788909150.302706:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788909150.302714:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799360:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909150.302743:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799360:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909150.302750:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00080000:3.0:1788909150.302769:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788909150.302775:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788909150.302777:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788909150.302917:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004798848 00000100:00100000:2.0:1788909150.302924:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004798848 00000100:00100000:2.0:1788909150.302971:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:2.0:1788909150.302980:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2347:x1875807004798848:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909150.303011:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2347:x1875807004798848:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909150.303018:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:1.0:1788909150.304754:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799104:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 2213us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909150.304774:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1788909150.341669:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019510016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909150.341801:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909150.341958:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019510016 00000100:00100000:1.0:1788909150.341989:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019510016 00000100:00100000:1.0:1788909150.342087:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788909150.342098:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019510016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788909150.342175:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909150.342243:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019510016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909150.342253:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788909150.342313:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d425f80 x1875807019510016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909150.342340:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019510016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788909150.342427:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788909150.920788:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909151.365831:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019510144:0@lo:400:kworker.0 00000100:00100000:1.0:1788909151.365929:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909151.366067:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019510144 00000100:00100000:2.0:1788909151.366079:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019510144 00000100:00100000:2.0:1788909151.366164:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788909151.366175:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019510144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.366252:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019510144:12345-0@lo:400:kworker.0 Request processed in 77us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909151.366259:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788909151.366319:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019510272:0@lo:400:kworker.0 00000100:00100000:3.0:1788909151.366343:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019510400:0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.366348:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909151.366370:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019510784:0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.366395:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909151.366398:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909151.366442:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019510656:0@lo:400:kworker.0 00000100:00100000:3.0:1788909151.367058:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019510528:0@lo:400:kworker.0 00000100:00100000:3.0:1788909151.367133:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909151.367178:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019510784 00000100:00100000:3.0:1788909151.367184:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019510784 00000100:00100000:2.0:1788909151.367200:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019510272 00000100:00100000:2.0:1788909151.367206:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019510272 00000100:00100000:3.0:1788909151.367240:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019510528 00000100:00100000:2.0:1788909151.367240:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019510400 00000100:00100000:3.0:1788909151.367244:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019510528 00000100:00100000:2.0:1788909151.367249:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019510400 00000100:00100000:3.0:1788909151.367269:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788909151.367279:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019510784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909151.367331:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019510784:12345-0@lo:400:kworker.0 Request processed in 53us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909151.367338:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788909151.367352:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788909151.367354:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788909151.367361:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019510528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.367361:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019510272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.367399:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019510272:12345-0@lo:400:kworker.0 Request processed in 41us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909151.367402:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019510528:12345-0@lo:400:kworker.0 Request processed in 42us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909151.367406:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788909151.367413:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788909151.367420:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788909151.367428:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019510400:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788909151.367439:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788909151.367446:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909151.367457:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019510400:12345-0@lo:400:kworker.0 Request processed in 31us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909151.367463:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788909151.367486:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cb93800 x1875807019510528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788909151.367487:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89053cb90e00 x1875807019510784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909151.367502:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019510528:0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.367502:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019510784:0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.367514:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019510272:0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.367524:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788909151.367530:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019510912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909151.367567:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019510400:0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.367567:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909151.367594:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019510912 00000100:00100000:2.0:1788909151.367599:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019510912 00000100:00100000:3.0:1788909151.367645:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788909151.367659:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019510912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788909151.367697:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909151.367752:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019510912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909151.367759:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788909151.367779:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d666680 x1875807019510912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909151.367795:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019510912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909151.368402:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909151.368441:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019510144:0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.368505:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019510656 00000100:00100000:2.0:1788909151.368511:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019510656 00000100:00100000:2.0:1788909151.368566:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788909151.368573:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019510656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909151.368610:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019510656:12345-0@lo:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909151.368615:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788909151.368630:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909151.368683:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019510656:0@lo:400:kworker.0 00010000:00010000:1.0:1788909151.941364:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909152.965501:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909153.989333:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909155.016641:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909155.416893:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909155.416940:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909155.416965:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909155.416983:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909155.417009:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909155.417038:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004799744 00000100:00100000:3.0:1788909155.417049:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004799744 00000100:00100000:3.0:1788909155.417130:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004799616 00000100:00100000:3.0:1788909155.417145:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004799616 00000100:00100000:3.0:1788909155.417339:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:3.0:1788909155.417352:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799744:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909155.417447:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799744:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 98us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909155.417456:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:3.0:1788909155.417488:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:3.0:1788909155.417495:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004799616:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909155.417519:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004799616:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909155.417525:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:2.0:1788909155.422243:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004799488 00000100:00100000:2.0:1788909155.422265:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004799488 00000100:00100000:2.0:1788909155.422354:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:2.0:1788909155.422366:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2347:x1875807004799488:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909155.422457:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2347:x1875807004799488:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 93us (5574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909155.422478:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00080000:2.0:1788909155.422524:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909155.424043:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004800000 00000100:00100000:1.0:1788909155.424053:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004800000 00000100:00100000:1.0:1788909155.424144:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004799872 00000100:00100000:1.0:1788909155.424149:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004799872 00000100:00100000:1.0:1788909155.424192:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1788909155.424203:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004800000:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909155.424264:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004800000:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 64us (7298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909155.424272:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1788909155.424287:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788909155.424294:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799872:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909155.424329:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004799872:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (7319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909155.424336:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00080000:0.0:1788909155.430443:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788909155.430457:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909155.464762:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788909155.464783:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019511040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788909155.464860:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909155.464924:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019511040 00000100:00100000:2.0:1788909155.464931:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019511040 00000100:00100000:2.0:1788909155.464999:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788909155.465008:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019511040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788909155.465053:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909155.465098:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019511040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909155.465104:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788909155.465147:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788909155.467095:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d666680 x1875807019511040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909155.467146:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019511040:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788909156.037493:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909156.486391:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040355ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019511168:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.486486:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909156.486545:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019511680:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.486571:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909156.486602:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788909156.486608:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019511552:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.486630:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909156.486679:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019511680 00000100:00100000:1.0:1788909156.486688:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019511680 00000100:00100000:1.0:1788909156.486742:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788909156.486752:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019511680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.486796:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019511680:12345-0@lo:400:kworker.0 Request processed in 46us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909156.486802:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788909156.486821:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019511552 00000100:00100000:1.0:1788909156.486824:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019511552 00000100:00100000:1.0:1788909156.486843:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788909156.486848:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019511552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.486883:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019511552:12345-0@lo:400:kworker.0 Request processed in 34us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909156.486899:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788909156.486933:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890403558380 x1875807019511552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909156.486948:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019511552:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.486958:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019511680:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.487001:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019511424:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.487023:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909156.487039:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788909156.487043:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019511296:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.487073:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909156.487088:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040355a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019511808:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.487369:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909156.487402:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019511424 00000100:00100000:1.0:1788909156.487405:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019511424 00000100:00100000:1.0:1788909156.487428:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019511296 00000100:00100000:1.0:1788909156.487431:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019511296 00000100:00100000:1.0:1788909156.487458:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788909156.487464:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019511424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.487496:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019511424:12345-0@lo:400:kworker.0 Request processed in 33us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909156.487501:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788909156.487511:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788909156.487516:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019511296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.487535:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019511296:12345-0@lo:400:kworker.0 Request processed in 19us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909156.487545:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788909156.487560:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019511808 00000100:00100000:1.0:1788909156.487563:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019511808 00000100:00100000:1.0:1788909156.487586:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788909156.487591:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019511808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.487617:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019511808:12345-0@lo:400:kworker.0 Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909156.487622:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788909156.487660:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019511296:0@lo:400:kworker.0 00010000:00080000:1.0:1788909156.487669:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89040355a680 x1875807019511808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909156.487677:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040355a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019511808:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.487685:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019511424:0@lo:400:kworker.0 00000100:00080000:1.0:1788909156.487719:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788909156.487723:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909156.490915:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019511168 00000100:00100000:0.0:1788909156.490938:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019511168 00000100:00100000:0.0:1788909156.491030:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788909156.491041:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019511168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909156.491560:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019511168:12345-0@lo:400:kworker.0 Request processed in 520us (5072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909156.491570:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788909156.491999:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040355ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019511168:0@lo:400:kworker.0 00000100:00100000:1.0:1788909156.492906:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909156.492927:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019511936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909156.492992:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909156.493324:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019511936 00000100:00100000:2.0:1788909156.493335:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019511936 00000100:00100000:2.0:1788909156.493381:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788909156.493392:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019511936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788909156.493450:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909156.493509:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019511936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909156.493517:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788909156.493617:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890537e92680 x1875807019511936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909156.493713:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019511936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788909157.061475:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909158.086642:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909159.109554:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788909160.118969:0:11017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788909160.134440:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909160.545708:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909160.545754:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909160.545799:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909160.545808:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004800128 00000100:00100000:1.0:1788909160.545819:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004800128 00000100:00100000:3.0:1788909160.545834:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909160.545870:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909160.545877:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:1.0:1788909160.545888:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004800128:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909160.545897:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004800512 00000100:00100000:3.0:1788909160.545903:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004800512 00000100:00100000:3.0:1788909160.545944:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004800640 00000100:00100000:3.0:1788909160.545948:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004800640 00000100:00100000:1.0:1788909160.545960:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004800128:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909160.545968:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:3.0:1788909160.545976:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788909160.545986:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2346:x1875807004800512:12345-192.168.204.54@tcp:9:kworker.0 00000100:00080000:1.0:1788909160.545999:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788909160.546003:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788909160.546008:0:8092:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d56a0 00000100:00080000:3.0:1788909160.546018:0:8092:0:(import.c:65:import_set_state_nolock()) ffff890508529800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788909160.546063:0:8092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788909160.546166:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1788909160.546174:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae3d4805-3977-4f79-88af-684dce002b2f+5:2346:x1875807004800640:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:1.0:1788909160.546190:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d56a7 00000100:00080000:1.0:1788909160.546196:0:6676:0:(import.c:65:import_set_state_nolock()) ffff89052d8dd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788909160.546220:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788909160.546470:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae3d4805-3977-4f79-88af-684dce002b2f+2:2346:x1875807004800640:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 297us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909160.546477:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:1.0:1788909160.546498:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909160.546562:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909160.549223:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004800384 00000100:00100000:0.0:1788909160.549252:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004800384 00000100:00100000:0.0:1788909160.549370:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004800256 00000100:00100000:0.0:1788909160.549375:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004800256 00000100:00100000:0.0:1788909160.549421:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:0.0:1788909160.549433:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004800384:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909160.549782:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ae3d4805-3977-4f79-88af-684dce002b2f+2:2346:x1875807004800512:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 3796us (3946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909160.549807:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788909160.549856:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:0.0:1788909160.549858:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004800384:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 425us (4100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909160.549871:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004800256:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909160.549881:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:1.0:1788909160.549929:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004800256:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 51us (4117us total) trans 0 rc 0/0 00000100:00080000:0.0:1788909160.549936:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909160.549937:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:1.0:1788909160.581503:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019512064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909160.581583:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909160.581803:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019512064 00000100:00100000:2.0:1788909160.581811:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019512064 00000100:00100000:2.0:1788909160.581865:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788909160.581874:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019512064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788909160.581904:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909160.581953:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019512064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909160.581960:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788909160.582009:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d665880 x1875807019512064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788909160.582030:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909160.582032:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019512064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788909161.160541:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909161.605357:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019512576:0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.605364:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019512192:0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.605452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909161.605456:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909161.605505:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019512576 00000100:00100000:2.0:1788909161.605521:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019512704:0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.605553:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909161.605600:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019512320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909161.605628:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909161.605647:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019512832:0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.605690:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909161.605710:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788909161.605715:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019512448:0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.605736:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909161.605753:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019512960:0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.605791:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909161.605824:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019512192 00000100:00100000:2.0:1788909161.605833:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019512192 00000100:00100000:2.0:1788909161.605878:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788909161.605886:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019512192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.605933:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019512192:12345-0@lo:400:kworker.0 Request processed in 47us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909161.605941:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788909161.605974:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019512320 00000100:00100000:2.0:1788909161.605978:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019512320 00000100:00100000:2.0:1788909161.606017:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788909161.606023:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019512320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788909161.606161:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909161.606206:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019512320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909161.606208:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019512576 00000100:00100000:2.0:1788909161.606216:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788909161.606241:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019512832 00000100:00100000:2.0:1788909161.606246:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019512832 00000100:00100000:1.0:1788909161.606252:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019512448 00000100:00100000:1.0:1788909161.606257:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019512448 00000100:00100000:2.0:1788909161.606273:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788909161.606281:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019512576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.606319:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019512576:12345-0@lo:400:kworker.0 Request processed in 39us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909161.606479:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019512704 00000100:00100000:3.0:1788909161.606484:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019512704 00000100:00100000:3.0:1788909161.606511:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019512960 00000100:00100000:3.0:1788909161.606514:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019512960 00000100:00100000:3.0:1788909161.606534:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788909161.606541:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019512704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909161.606579:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019512704:12345-0@lo:400:kworker.0 Request processed in 38us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909161.606585:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788909161.606598:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788909161.606605:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019512960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909161.606633:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019512960:12345-0@lo:400:kworker.0 Request processed in 29us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909161.606638:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788909161.609672:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788909161.609690:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788909161.609697:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019512832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.609723:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788909161.609734:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019512448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909161.609796:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019512832:12345-0@lo:400:kworker.0 Request processed in 111us (4105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909161.609804:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788909161.609839:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019512448:12345-0@lo:400:kworker.0 Request processed in 107us (4100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909161.609847:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788909161.609866:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788909161.609871:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909161.609910:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019512576:0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.609953:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019512448:0@lo:400:kworker.0 00010000:00080000:2.0:1788909161.609968:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d6fb480 x1875807019512960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909161.609979:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019512960:0@lo:400:kworker.0 00010000:00080000:2.0:1788909161.609988:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890537e90000 x1875807019512320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909161.610004:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019512320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909161.610013:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019512832:0@lo:400:kworker.0 00000100:00100000:2.0:1788909161.610179:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019512192:0@lo:400:kworker.0 00010000:00080000:2.0:1788909161.610198:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d6f9180 x1875807019512704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909161.610209:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019512704:0@lo:400:kworker.0 00010000:00010000:0.0:1788909162.183932:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909163.211655:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788909163.313447:0:11165:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcba5a4f10 20000000:00000080:0.0:1788909163.313475:0:11165:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890401889400 uarg=0000000000000000 20000000:01000000:0.0:1788909163.313524:0:11165:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788909163.313531:0:11165:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788909163.313539:0:11165:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788909163.314735:0:11166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788909163.314937:0:11165:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788909163.324821:0:11165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788909163.324983:0:11165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325021:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444ad expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325032:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d565a expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325039:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5668 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325057:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d5676 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325065:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444e5 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325092:0:11165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325445:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444e5 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325459:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444e5 expref: 12 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909163.325474:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513088:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788909163.325599:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d5676 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325608:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d5676 expref: 18 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909163.325617:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e92d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513216:0@lo:104: 00000100:00100000:1.0:1788909163.325673:0:11165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788909163.325707:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d5668 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325716:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d5668 expref: 18 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909163.325724:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513344:0@lo:104: 00000100:00100000:1.0:1788909163.325746:0:11165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788909163.325773:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d565a expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325793:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d565a expref: 18 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909163.325801:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513472:0@lo:104: 00000100:00100000:1.0:1788909163.325826:0:11165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788909163.325849:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444ad expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.325857:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444ad expref: 12 pid: 5815 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909163.325866:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513600:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909163.325890:0:11165:0:(client.c:2715:ptlrpc_set_wait()) set ffff890503fc8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788909163.325927:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019513216 00000100:00100000:1.0:1788909163.325934:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019513216 00000100:00100000:1.0:1788909163.325971:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019513344 00000100:00100000:1.0:1788909163.325975:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019513344 00000100:00100000:1.0:1788909163.325984:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019513472 00000100:00100000:1.0:1788909163.325987:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019513472 00000100:00100000:1.0:1788909163.326015:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788909163.326025:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+5:11165:x1875807019513216:12345-0@lo:104: 00010000:00010000:1.0:1788909163.326037:0:7631:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326101:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788909163.326133:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+5:11165:x1875807019513216:12345-0@lo:104: Request processed in 85us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909163.326141:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788909163.326171:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788909163.326177:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+4:11165:x1875807019513344:12345-0@lo:104: 00010000:00010000:1.0:1788909163.326185:0:7631:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326221:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788909163.326226:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+4:11165:x1875807019513344:12345-0@lo:104: Request processed in 50us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909163.326232:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788909163.326244:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788909163.326250:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+3:11165:x1875807019513472:12345-0@lo:104: 00010000:00010000:1.0:1788909163.326258:0:7631:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326289:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788909163.326294:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:de4f34ee-762f-480d-9428-329e99488659+3:11165:x1875807019513472:12345-0@lo:104: Request processed in 45us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909163.326299:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788909163.326327:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788909163.326334:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326341:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9600 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:1.0:1788909163.326345:0:6689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326353:0:6689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788909163.326371:0:6689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909163.326378:0:6689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788909163.326407:0:6689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326413:0:6689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788909163.326432:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326439:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89050bad9600/0x733cfdd8721d5676 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d567d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326454:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788909163.326457:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326462:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10000 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:1.0:1788909163.326464:0:6689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326471:0:6689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788909163.326477:0:6689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909163.326482:0:6689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788909163.326502:0:6689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326508:0:6689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788909163.326515:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326520:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89052dc10000/0x733cfdd8721d5668 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d566f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326531:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909163.326534:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326539:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:1.0:1788909163.326542:0:6689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326549:0:6689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788909163.326555:0:6689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909163.326560:0:6689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788909163.326573:0:6689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326579:0:6689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788909163.326593:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326608:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89050bad9200/0x733cfdd8721d565a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d5661 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909163.326621:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909163.326622:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909163.326624:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909163.326631:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909163.326637:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909163.326679:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e92d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513216:0@lo:104: 00000100:00100000:1.0:1788909163.326688:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513344:0@lo:104: 00000100:00100000:1.0:1788909163.326695:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513472:0@lo:104: 00000100:00100000:2.0:1788909163.326803:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019513728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909163.326853:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909163.326900:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909163.326907:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019513856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909163.326931:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909163.326961:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019513984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909163.326985:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909163.327024:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019513728 00000100:00100000:2.0:1788909163.327029:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019513728 00010000:00010000:2.0:1788909163.327053:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5676 expref: 19 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909163.327075:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019513856 00000100:00100000:2.0:1788909163.327077:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019513856 00010000:00010000:2.0:1788909163.327087:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5668 expref: 20 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909163.327095:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019513984 00000100:00100000:2.0:1788909163.327097:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019513984 00010000:00010000:2.0:1788909163.327105:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d565a expref: 21 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909163.327153:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788909163.327161:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+21:3285:x1875807019513728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909163.327173:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909163.327179:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5676 expref: 21 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.327189:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d5676 expref: 21 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.327217:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad9000/0x733cfdd8721d567d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d5676 expref: 21 pid: 5817 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.327233:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909163.327264:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+20:3285:x1875807019513728:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909163.327271:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788909163.327327:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788909163.327333:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019513856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909163.327341:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909163.327345:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d5668 expref: 19 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.327353:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d5668 expref: 19 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.327362:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc11c00/0x733cfdd8721d566f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d5668 expref: 19 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.327373:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909163.327395:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+18:3285:x1875807019513856:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909163.327400:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788909163.327411:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788909163.327416:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+17:3283:x1875807019513984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909163.327423:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909163.327426:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d565a expref: 17 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.327439:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d565a expref: 17 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.327449:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad9e00/0x733cfdd8721d5661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d565a expref: 17 pid: 5815 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.327457:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909163.327481:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+16:3283:x1875807019513984:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909163.327487:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788909163.327520:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019513984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909163.327543:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019513856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909163.327549:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019513728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909163.336792:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909163.336891:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513088:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909163.336906:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004800768 00000100:00100000:2.0:1788909163.336906:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875807019513600:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909163.336942:0:11165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909163.336972:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004800768 00010000:00010000:3.0:1788909163.337013:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444ad expref: 13 pid: 5815 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909163.337169:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788909163.337179:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2348:x1875807004800768:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909163.337192:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909163.337198:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444ad expref: 13 pid: 5815 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909163.337209:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444ad expref: 13 pid: 5815 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909163.337228:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc10e00/0x733cfdd8721d5653 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444ad expref: 13 pid: 5815 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909163.337254:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909163.337323:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:2348:x1875807004800768:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 145us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909163.337331:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1788909163.338832:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909163.339838:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004800896 00000100:00100000:2.0:1788909163.339848:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004800896 00010000:00010000:2.0:1788909163.339879:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444e5 expref: 12 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909163.339959:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1788909163.339968:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:2350:x1875807004800896:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909163.339994:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909163.339999:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444e5 expref: 12 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340020:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444e5 expref: 12 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340037:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc10200/0x733cfdd8721d5692 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a444e5 expref: 12 pid: 5816 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340058:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340067:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340083:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340089:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340096:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340104:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340368:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909163.340372:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340392:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340420:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909163.340433:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909163.340508:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:2350:x1875807004800896:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 540us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909163.340517:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00010000:00010000:3.0:1788909163.340579:0:11165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909163.340588:0:11165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909163.340595:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501693000/0x733cfdd8721d56ae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788909163.714383:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae3d4805-3977-4f79-88af-684dce002b2f 00000020:00000080:1.0:1788909163.714393:0:6701:0:(genops.c:885:class_export_put()) final put ffff890508529000/ae3d4805-3977-4f79-88af-684dce002b2f 00000020:00000080:3.0:1788909163.714445:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff890508529000/ae3d4805-3977-4f79-88af-684dce002b2f for lustre-OST0000 00000020:00000080:3.0:1788909163.714504:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff890508529800 for lustre-OST0000 00010000:00010000:0.0:1788909164.233501:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909164.634297:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909164.635023:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004801024 00000100:00100000:2.0:1788909164.635038:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004801024 00000100:00100000:2.0:1788909164.635161:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:2.0:1788909164.635174:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:5591:x1875807004801024:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909164.635192:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909164.635215:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a4450f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.635248:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4450f expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.635260:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4450f expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.635270:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10c00, rc 0) 00000100:00100000:2.0:1788909164.635352:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004801024:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 180us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909164.635376:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:0.0:1788909164.643714:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909164.643831:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004801152 00000100:00100000:3.0:1788909164.643845:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004801152 00000100:00100000:3.0:1788909164.643922:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:3.0:1788909164.643936:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004801152:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909164.644304:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004801152:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 371us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909164.644312:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:2.0:1788909164.654966:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909164.655171:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004801280 00000100:00100000:3.0:1788909164.655187:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004801280 00000100:00100000:3.0:1788909164.655248:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:3.0:1788909164.655260:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004801280:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909164.655814:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004801280:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 554us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909164.655823:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 225 10000000:01000000:1.0:1788909164.677479:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788909164.677492:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905375be800 from 7 10000000:01000000:1.0:1788909164.677499:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788909164.677556:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909164.677571:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909164.677586:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909164.677616:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788909164.677691:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909164.677751:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788909164.677887:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019514112 00000100:00100000:2.0:1788909164.677895:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019514112 00000100:00100000:2.0:1788909164.677959:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788909164.677967:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019514112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909164.677979:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909164.677992:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d56bc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.678016:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d56bc expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.678027:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d56bc expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.678035:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909164.678074:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019514112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909164.678080:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788909164.678383:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788909164.678399:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909164.678408:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909164.678473:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788909164.678500:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909164.678522:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788909164.678974:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019514240 00000100:00100000:2.0:1788909164.678981:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019514240 00000100:00100000:2.0:1788909164.679022:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788909164.679030:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019514240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909164.679373:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019514240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909164.679380:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788909164.679428:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909164.679477:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d667800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909164.679513:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909164.679526:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502f70f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788909164.679880:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019514368 00000100:00100000:1.0:1788909164.679886:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019514368 00000100:00100000:1.0:1788909164.679916:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788909164.679922:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019514368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788909164.680084:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019514368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909164.680090:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788909164.680161:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d667800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788909164.680987:0:11198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788909164.682674:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788909164.682706:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788909164.682717:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.682730:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909164.682742:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788909164.682745:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905068d9800 from 7 10000000:01000000:2.0:1788909164.682748:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788909164.682794:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.682803:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.682815:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909164.682841:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d664a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788909164.682893:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909164.682926:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502f70840 going to sleep for 11 seconds 00000100:00100000:2.0:1788909164.682948:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019514496 00000100:00100000:2.0:1788909164.682953:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019514496 00000100:00100000:2.0:1788909164.683007:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788909164.683014:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019514496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909164.683026:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909164.683038:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d56ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.683061:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d56ca expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909164.683072:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:2.0:1788909164.683077:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d56ca expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.683087:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11800, rc 0) 00000100:00100000:2.0:1788909164.683147:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019514496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909164.683154:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788909164.683184:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004801408 00000100:00100000:2.0:1788909164.683202:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004801408 00000100:00100000:2.0:1788909164.683222:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:2.0:1788909164.683228:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004801408:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909164.683245:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909164.683255:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a44516 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.683267:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44516 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.683274:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44516 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.683302:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11a00, rc 0) 00000100:00100000:2.0:1788909164.683356:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004801408:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 126us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909164.683362:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:2.0:1788909164.683402:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d664a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909164.683415:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909164.683424:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909164.683487:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d664a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909164.683509:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909164.683520:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502f70840 going to sleep for 11 seconds 00000100:00100000:2.0:1788909164.683529:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019514624 00000100:00100000:2.0:1788909164.683532:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019514624 00000100:00100000:2.0:1788909164.683547:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788909164.683551:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019514624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909164.685721:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019514624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2158us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909164.685735:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788909164.688476:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d664a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909164.688555:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040355b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909164.688636:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909164.688680:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905205b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788909164.689552:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019514752 00000100:00100000:2.0:1788909164.689562:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019514752 00000100:00100000:2.0:1788909164.689611:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788909164.689620:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019514752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909164.689855:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019514752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909164.689863:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788909164.690014:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909164.690131:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004801536 00000100:00100000:2.0:1788909164.690135:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004801536 00000100:00100000:2.0:1788909164.690164:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:2.0:1788909164.690170:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004801536:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909164.690751:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004801536:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 578us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909164.690760:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:0.0:1788909164.693823:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040355b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788909164.694782:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788909164.694876:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788909164.694906:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788909164.694919:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909164.694944:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909164.694954:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788909164.694957:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905103af000 from 7 10000000:01000000:0.0:1788909164.694960:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788909164.695922:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909164.695935:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909164.695945:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909164.695970:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040355b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788909164.696160:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909164.696205:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905205b40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909164.696294:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019514880 00000100:00100000:0.0:1788909164.696301:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019514880 00000100:00100000:0.0:1788909164.696344:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788909164.696353:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019514880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788909164.696366:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909164.696376:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d56df expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909164.696398:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d56df expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909164.696420:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d56df expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909164.696429:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ce00, rc 0) 00000100:00100000:0.0:1788909164.696473:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019514880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909164.696480:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788909164.696533:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040355b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019514880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788909164.697249:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909164.697260:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909164.697338:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040355b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019515008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909164.697377:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909164.697412:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905205b40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909164.697431:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019515008 00000100:00100000:0.0:1788909164.697436:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019515008 00000100:00100000:0.0:1788909164.697476:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788909164.697485:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019515008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909164.698139:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019515008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 654us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909164.698146:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788909164.698218:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909164.698250:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040355b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019515008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909164.698303:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040355b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019515136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909164.698338:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909164.698357:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905205b40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909164.698373:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004801664 00000100:00100000:0.0:1788909164.698377:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004801664 00000100:00100000:0.0:1788909164.698399:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019515136 00000100:00100000:0.0:1788909164.698402:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019515136 00000100:00100000:0.0:1788909164.698419:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:0.0:1788909164.698426:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004801664:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909164.698779:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004801664:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 351us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909164.698786:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:0.0:1788909164.698809:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788909164.698816:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019515136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909164.699381:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019515136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 563us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909164.699389:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788909164.701183:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040355b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019515136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788909164.703355:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788909164.703443:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788909164.703466:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788909164.703482:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909164.703696:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788909165.244280:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae3d4805-3977-4f79-88af-684dce002b2f 00000020:00000080:0.0:1788909165.244289:0:7643:0:(genops.c:885:class_export_put()) final put ffff89052d8da800/ae3d4805-3977-4f79-88af-684dce002b2f 00000020:00000080:1.0:1788909165.244454:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff89052d8da800/ae3d4805-3977-4f79-88af-684dce002b2f for lustre-OST0001 00000020:00000080:1.0:1788909165.244658:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89052d8dd800 for lustre-OST0001 00010000:00010000:1.0:1788909165.255514:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909165.664764:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909165.664826:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909165.664859:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909165.664895:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004801920 00000100:00100000:1.0:1788909165.664905:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004801920 00000100:00100000:0.0:1788909165.665042:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004801792 00000100:00100000:0.0:1788909165.665047:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004801792 00000100:00100000:0.0:1788909165.665087:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:0.0:1788909165.665097:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004801792:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909165.665223:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004801792:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 128us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909165.665232:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:1.0:1788909165.665544:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004802048 00000100:00100000:1.0:1788909165.665549:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004802048 00000100:00100000:1.0:1788909165.665592:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1788909165.665601:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004801920:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909165.665646:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004801920:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 46us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909165.665652:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:1.0:1788909165.665666:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:1.0:1788909165.665672:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004802048:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909165.665697:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004802048:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 25us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909165.665704:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00080000:1.0:1788909165.665722:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909165.701796:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788909165.701819:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019515264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788909165.701915:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909165.702003:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019515264 00000100:00100000:2.0:1788909165.702013:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019515264 00000100:00100000:2.0:1788909165.702071:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788909165.702080:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019515264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788909165.702142:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909165.702189:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019515264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909165.702196:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788909165.702240:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d665180 x1875807019515264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909165.702272:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019515264:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788909165.702357:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788909166.277796:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909166.726154:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019515392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909166.726258:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909166.726350:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019515392 00000100:00100000:1.0:1788909166.726359:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019515392 00000100:00100000:1.0:1788909166.726414:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788909166.726425:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019515392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909166.726464:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909166.726508:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019515392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909166.726521:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788909166.726542:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788909166.726572:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890537e93800 x1875807019515392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909166.726591:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019515392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909166.726999:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019515648:0@lo:400:kworker.0 00000100:00100000:1.0:1788909166.727031:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909166.727053:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909166.727059:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019515776:0@lo:400:kworker.0 00000100:00100000:1.0:1788909166.727081:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909166.727128:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019515648 00000100:00100000:1.0:1788909166.727133:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019515648 00000100:00100000:1.0:1788909166.727170:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019515776 00000100:00100000:1.0:1788909166.727173:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019515776 00000100:00100000:3.0:1788909166.727352:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019515520:0@lo:400:kworker.0 00000100:00100000:3.0:1788909166.727390:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909166.727420:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019516032:0@lo:400:kworker.0 00000100:00100000:3.0:1788909166.727441:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909166.727761:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788909166.727769:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019515904:0@lo:400:kworker.0 00000100:00100000:3.0:1788909166.727798:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909166.727833:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019515520 00000100:00100000:3.0:1788909166.727838:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019515520 00000100:00100000:0.0:1788909166.727863:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019515904 00000100:00100000:0.0:1788909166.727868:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019515904 00000100:00100000:3.0:1788909166.727870:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788909166.727877:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019515520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909166.727895:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788909166.727901:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019515904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909166.727933:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019515520:12345-0@lo:400:kworker.0 Request processed in 55us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909166.727933:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019515904:12345-0@lo:400:kworker.0 Request processed in 32us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909166.727940:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788909166.727940:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788909166.727987:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890537e92d80 x1875807019515904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909166.728001:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019515904:0@lo:400:kworker.0 00000100:00100000:3.0:1788909166.728012:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019515520:0@lo:400:kworker.0 00000100:00100000:1.0:1788909166.728083:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019516032 00000100:00100000:1.0:1788909166.728088:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019516032 00000100:00100000:1.0:1788909166.728137:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788909166.728174:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019515648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909166.728413:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019515648:12345-0@lo:400:kworker.0 Request processed in 240us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909166.728420:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788909166.728435:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788909166.728442:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019515776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909166.728474:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019515776:12345-0@lo:400:kworker.0 Request processed in 33us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909166.728479:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788909166.728631:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788909166.728640:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019516032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909166.728677:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019516032:12345-0@lo:400:kworker.0 Request processed in 39us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909166.728683:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788909166.728711:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019516032:0@lo:400:kworker.0 00000100:00080000:1.0:1788909166.729030:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909166.729055:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019515776:0@lo:400:kworker.0 00000100:00100000:1.0:1788909166.729067:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019515648:0@lo:400:kworker.0 00010000:00010000:0.0:1788909167.302801:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788909167.360784:0:11363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788909168.326471:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909169.352078:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909170.373441:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909170.776692:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909170.776791:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909170.776825:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909170.776938:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004802432 00000100:00100000:2.0:1788909170.776968:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004802432 00000100:00100000:2.0:1788909170.777047:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004802304 00000100:00100000:2.0:1788909170.777050:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004802304 00000100:00100000:2.0:1788909170.777078:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:2.0:1788909170.777089:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004802432:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909170.777244:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004802432:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 157us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909170.777252:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:2.0:1788909170.777273:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1788909170.777280:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004802304:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909170.777307:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004802304:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909170.777313:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00080000:1.0:1788909170.777547:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909170.778149:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004802176 00000100:00100000:0.0:1788909170.778159:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004802176 00000100:00100000:2.0:1788909170.778297:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 240 00000100:00100000:2.0:1788909170.778308:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2350:x1875807004802176:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909170.778370:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2350:x1875807004802176:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 64us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909170.778377:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 240 00000100:00100000:1.0:1788909170.821384:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019516160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909170.821493:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909170.821667:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019516160 00000100:00100000:0.0:1788909170.821677:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019516160 00000100:00100000:0.0:1788909170.821772:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788909170.821792:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019516160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788909170.821848:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788909170.821936:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909170.824448:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019516160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2646us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909170.824466:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788909170.829546:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d665180 x1875807019516160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909170.829582:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019516160:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788909171.327573:0:11465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:12:49 (1788909169) === 00010000:00010000:0.0:1788909171.397808:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909171.524386:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909171.524513:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909171.524554:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004802688 00000100:00100000:1.0:1788909171.524564:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004802688 00000100:00100000:1.0:1788909171.524614:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788909171.524624:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:9687:x1875807004802688:12345-192.168.204.54@tcp:700:mkdir.0 00000100:00100000:1.0:1788909171.524721:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:9687:x1875807004802688:12345-192.168.204.54@tcp:700:mkdir.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909171.524731:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788909171.525187:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004802560 00000100:00100000:3.0:1788909171.525193:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004802560 00000100:00100000:3.0:1788909171.525233:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788909171.525241:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004802560:12345-192.168.204.54@tcp:41:mkdir.0 00000004:00000024:3.0:1788909171.525306:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788909171.525388:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004802560:12345-192.168.204.54@tcp:41:mkdir.0 Request processed in 147us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909171.525415:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788909171.527934:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909171.528007:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004802944 00000100:00100000:3.0:1788909171.528017:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004802944 00000100:00100000:3.0:1788909171.528075:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1788909171.528085:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:9687:x1875807004802944:12345-192.168.204.54@tcp:36:mkdir.0 00010000:00010000:3.0:1788909171.528182:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909171.528257:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d800/0x733cfdd8721d55ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44498 expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.528350:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510bdee00) 00010000:00010000:3.0:1788909171.528361:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909171.528675:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.528689:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.528699:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.528725:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.528733:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.528739:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909171.533021:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788909171.533047:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.533059:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.533067:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.533074:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909171.533079:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.533089:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.533105:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890507e13700) 00010000:00010000:3.0:1788909171.533128:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909171.533133:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.533140:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d56ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788909171.533171:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5bc3c29 reply state 00000000fd100fcb transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909171.533180:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788909171.533290:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:9687:x1875807004802944:12345-192.168.204.54@tcp:36:mkdir.0 Request processed in 5202us (5361us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788909171.533299:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:3.0:1788909171.537617:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.537645:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.537653:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.537658:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909171.537662:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.537669:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.537686:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890507e13500) 00010000:00010000:3.0:1788909171.537690:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909171.537694:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.537700:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d56f4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909171.551569:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909171.551698:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004803072 00000100:00100000:3.0:1788909171.551714:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004803072 00000100:00100000:3.0:1788909171.551792:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1788909171.551808:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:9689:x1875807004803072:12345-192.168.204.54@tcp:101:chmod.0 00010000:00010000:3.0:1788909171.551834:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909171.551868:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d56fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4451d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.551972:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5702 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.551993:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.552012:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909171.552105:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788909171.552161:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788909171.552251:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.552823:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d56fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4451d expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.552952:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5702 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4451d expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.552962:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890507e13500) 00010000:00010000:3.0:1788909171.552965:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788909171.552969:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9600, rc 0) 00000100:00100000:3.0:1788909171.553063:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:9689:x1875807004803072:12345-192.168.204.54@tcp:101:chmod.0 Request processed in 1258us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909171.553075:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1788909171.562058:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909171.562501:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004803328 00000100:00100000:0.0:1788909171.562517:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004803328 00000100:00100000:1.0:1788909171.562702:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:1.0:1788909171.562717:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:9689:x1875807004803328:12345-192.168.204.54@tcp:36:chmod.0 00010000:00010000:1.0:1788909171.562795:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909171.562827:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5702 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4451d expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.562863:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890507e13500) 00010000:00010000:1.0:1788909171.562877:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788909171.562916:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.562930:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.562941:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788909171.563536:0:7640:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000575a380a reply state 00000000c9a21b3c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909171.563548:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788909171.563563:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788909171.563716:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:9689:x1875807004803328:12345-192.168.204.54@tcp:36:chmod.0 Request processed in 999us (1670us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788909171.563724:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00010000:00010000:0.0:1788909171.570535:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.570556:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.570563:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.570570:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909171.570575:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.570583:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.570599:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5600) 00010000:00010000:0.0:1788909171.570602:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788909171.570608:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.570614:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5709 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909171.602541:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909171.603309:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004803456 00000100:00100000:1.0:1788909171.603321:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004803456 00000100:00100000:2.0:1788909171.603876:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788909171.603890:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:9690:x1875807004803456:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:2.0:1788909171.603922:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909171.603965:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5710 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44524 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.604071:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d5717 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.604087:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d5717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.604101:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d5717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909171.604212:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788909171.604217:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909171.604267:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d5717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.604295:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44524 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.604314:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d5717 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44524 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.604322:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293600) 00010000:00010000:2.0:1788909171.604325:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909171.604328:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10e00, rc 0) 00000100:00100000:2.0:1788909171.605234:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:9690:x1875807004803456:12345-192.168.204.54@tcp:101:chown.0 Request processed in 1337us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909171.605259:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:1.0:1788909171.609073:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909171.610403:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004803584 00000100:00100000:3.0:1788909171.610416:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004803584 00000100:00100000:3.0:1788909171.610660:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1788909171.610673:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:9690:x1875807004803584:12345-192.168.204.54@tcp:101:chown.0 00010000:00010000:3.0:1788909171.610695:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909171.610715:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d571e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4452b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.610784:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.610798:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.610809:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.610824:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.610830:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.610836:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.610930:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.610939:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.610963:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909171.611002:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788909171.611007:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788909171.611031:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611042:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611048:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611055:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611061:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909171.611065:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611072:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611085:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293600) 00010000:00010000:3.0:1788909171.611088:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909171.611092:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611098:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611179:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611185:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611190:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611195:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909171.611199:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611205:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611213:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890507e13700) 00010000:00010000:3.0:1788909171.611215:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909171.611218:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611223:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d572c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611266:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d571e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4452b expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611280:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4452b expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.611298:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890507e13b00) 00010000:00010000:3.0:1788909171.611300:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788909171.611303:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9a00, rc 0) 00000100:00100000:3.0:1788909171.611377:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:9690:x1875807004803584:12345-192.168.204.54@tcp:101:chown.0 Request processed in 707us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909171.611385:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788909171.619047:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909171.619166:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004803840 00000100:00100000:2.0:1788909171.619180:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004803840 00000100:00100000:2.0:1788909171.619272:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788909171.619282:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:9690:x1875807004803840:12345-192.168.204.54@tcp:36:chown.0 00010000:00010000:2.0:1788909171.619540:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909171.619572:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4452b expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.619597:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890507e13b00) 00010000:00010000:2.0:1788909171.619610:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909171.619725:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.619741:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.619752:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788909171.672190:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1788909171.672212:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788909171.672335:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000073fcc8d reply state 00000000543da449 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909171.672349:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788909171.672505:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1788909171.672648:0:5824:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788909171.672787:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:9690:x1875807004803840:12345-192.168.204.54@tcp:36:chown.0 Request processed in 53500us (53747us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788909171.672810:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00010000:00010000:3.0:1788909171.673394:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.673408:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.673417:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.673424:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909171.673429:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.673439:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.673459:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890510293800) 00010000:00010000:3.0:1788909171.673463:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788909171.673470:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.673489:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d573a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909171.698853:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909171.698937:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004803968 00000100:00100000:1.0:1788909171.698951:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004803968 00000100:00100000:1.0:1788909171.699027:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1788909171.699039:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:9691:x1875807004803968:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:1.0:1788909171.699070:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909171.699095:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5741 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44532 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788909171.711957:0:7640:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 12740us 00010000:00010000:1.0:1788909171.734400:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.734436:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.734451:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.734472:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.734480:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.734487:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.735479:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693000/0x733cfdd8721d5756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.735504:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693000/0x733cfdd8721d5756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.735516:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693000/0x733cfdd8721d5756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909171.735610:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788909171.735615:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909171.737208:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890501693000/0x733cfdd8721d5756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737231:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737237:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737244:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737250:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909171.737254:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737261:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737277:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293600) 00010000:00010000:1.0:1788909171.737280:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909171.737286:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737304:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d5748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737320:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737326:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737331:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737336:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909171.737349:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737355:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737363:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890520ac5500) 00010000:00010000:1.0:1788909171.737367:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909171.737369:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737375:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d574f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737517:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5741 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44532 expref: 8 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737534:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693000/0x733cfdd8721d5756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44532 expref: 7 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.737548:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890520ac5300) 00010000:00010000:1.0:1788909171.737551:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788909171.737553:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693000, rc 0) 00000100:00100000:1.0:1788909171.737638:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:9691:x1875807004803968:12345-192.168.204.54@tcp:101:touch.500 Request processed in 38600us (38805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909171.738010:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788909171.743879:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909171.743956:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004804224 00000100:00100000:2.0:1788909171.743969:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004804224 00000100:00100000:2.0:1788909171.744039:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1788909171.744057:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:9691:x1875807004804224:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:2.0:1788909171.744082:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909171.744128:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d575d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44539 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.744842:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.744863:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.744886:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.744939:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.744947:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.744954:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788909171.746096:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788909171.746460:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d5772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746473:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d5772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746482:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d5772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746519:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746525:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746531:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746538:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909171.746550:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746619:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746634:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890520ac5300) 00010000:00010000:2.0:1788909171.746637:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909171.746642:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746649:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5764 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909171.746663:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044598cbb reply state 00000000359cceb1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909171.746672:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788909171.746708:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d575d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44539 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746727:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d5772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44539 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.746734:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff890510293500) 00010000:00010000:2.0:1788909171.746737:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909171.746739:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10800, rc 0) 00000100:00100000:2.0:1788909171.746826:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:9691:x1875807004804224:12345-192.168.204.54@tcp:101:touch.500 Request processed in 2777us (3210us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788909171.746835:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00010000:00010000:1.0:1788909171.753497:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.753519:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.753528:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.753534:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909171.753540:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.753547:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.753796:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff890510293c00) 00010000:00010000:1.0:1788909171.753801:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909171.753807:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.753814:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d576b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909171.762033:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909171.762784:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004804480 00000100:00100000:3.0:1788909171.762796:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004804480 00000100:00100000:3.0:1788909171.762950:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1788909171.762962:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:9691:x1875807004804480:12345-192.168.204.54@tcp:36:touch.500 00010000:00010000:3.0:1788909171.763021:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909171.763055:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d5772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44539 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.763077:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff890510293500) 00010000:00010000:3.0:1788909171.763088:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909171.765395:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.765419:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.765432:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788909171.765609:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000687cd996 reply state 0000000014374446 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909171.765619:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788909171.766055:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:9691:x1875807004804480:12345-192.168.204.54@tcp:36:touch.500 Request processed in 3092us (4030us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788909171.766066:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1788909171.774319:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909171.774620:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004804608 00000100:00100000:1.0:1788909171.774633:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004804608 00000100:00100000:1.0:1788909171.774711:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:1.0:1788909171.774723:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:9691:x1875807004804608:12345-192.168.204.54@tcp:101:touch.500 00010000:00010000:1.0:1788909171.774751:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909171.774773:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5787 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44540 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.774860:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5787 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44540 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.774971:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5787 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44540 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.774997:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff890507e13b00) 00010000:00010000:1.0:1788909171.775000:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788909171.775004:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693600, rc 0) 00000100:00100000:1.0:1788909171.775061:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:9691:x1875807004804608:12345-192.168.204.54@tcp:101:touch.500 Request processed in 340us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909171.775068:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00010000:00010000:3.0:1788909171.778184:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.778203:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909171.778250:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1788909171.778335:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.778342:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909171.778348:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.778356:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.778372:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff890507e13b00) 00010000:00010000:3.0:1788909171.778375:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909171.778379:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.778385:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5780 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909171.778408:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004804736 00000100:00100000:1.0:1788909171.778419:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004804736 00000100:00100000:1.0:1788909171.778522:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1788909171.778530:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875807004804736:12345-192.168.204.54@tcp:8:touch.500 00010000:00080000:1.0:1788909171.778564:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:1.0:1788909171.778593:0:6673:0:(genops.c:1385:class_connect()) connect: client 9a693284-9812-4b47-95bb-9bc33a7c4ef4, cookie 0x733cfdd8721d578e 00002000:00100000:1.0:1788909171.778621:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9a693284-9812-4b47-95bb-9bc33a7c4ef4/ffff89050852d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788909171.778633:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788909171.778879:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788909171.778909:0:6673:0:(import.c:65:import_set_state_nolock()) ffff890508528000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788909171.778981:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2346:x1875807004804736:12345-192.168.204.54@tcp:8:touch.500 Request processed in 450us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909171.778990:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788909171.781681:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909171.781776:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004804864 00000100:00100000:3.0:1788909171.781788:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004804864 00000100:00100000:3.0:1788909171.781891:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788909171.781902:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:0:x1875807004804864:12345-192.168.204.54@tcp:2:touch.500 00000100:00080000:2.0:1788909171.783050:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909171.821876:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:0:x1875807004804864:12345-192.168.204.54@tcp:2:touch.500 Request processed in 39961us (40190us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788909171.821891:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000001:00100000:1.0:1788909171.823510:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000001:00080000:1.0:1788909171.823531:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788909171.824978:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909171.825103:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004805120 00000100:00100000:0.0:1788909171.825173:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004805120 00000100:00100000:0.0:1788909171.825249:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1788909171.825262:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:9691:x1875807004805120:12345-192.168.204.54@tcp:35:touch.500 00000100:00100000:0.0:1788909171.825892:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:9691:x1875807004805120:12345-192.168.204.54@tcp:35:touch.500 Request processed in 630us (920us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788909171.825901:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788909171.842799:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909171.842949:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004805248 00000100:00100000:1.0:1788909171.842965:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004805248 00000100:00100000:1.0:1788909171.843041:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1788909171.843053:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:9692:x1875807004805248:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:1.0:1788909171.843080:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909171.843104:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d5795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44547 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.843241:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d579c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.843255:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d579c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.843267:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d579c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909171.843327:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788909171.843331:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909171.843506:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d579c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.843535:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d5795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44547 expref: 13 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.843556:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d579c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44547 expref: 12 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.843566:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890520ac5300) 00010000:00010000:1.0:1788909171.843570:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788909171.843574:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692600, rc 0) 00000100:00100000:1.0:1788909171.843647:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:9692:x1875807004805248:12345-192.168.204.54@tcp:101:rm.0 Request processed in 596us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909171.843654:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1788909171.845430:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019516416:0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.845516:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909171.845564:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019516928:0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.845588:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909171.845613:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788909171.845618:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019516544:0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.845636:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909171.845647:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019517056:0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.845665:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909171.845694:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019516416 00000100:00100000:2.0:1788909171.845702:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019516416 00000100:00100000:2.0:1788909171.845746:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788909171.845765:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019516416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.845808:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019516416:12345-0@lo:400:kworker.0 Request processed in 54us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909171.845815:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788909171.845852:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019516928 00000100:00100000:2.0:1788909171.845855:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019516928 00000100:00100000:2.0:1788909171.845887:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019516544 00000100:00100000:2.0:1788909171.845890:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019516544 00000100:00100000:2.0:1788909171.845906:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788909171.845922:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019516928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.845951:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019516928:12345-0@lo:400:kworker.0 Request processed in 39us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909171.845957:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788909171.845982:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788909171.845987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019516544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.846008:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019516544:12345-0@lo:400:kworker.0 Request processed in 22us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909171.846014:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788909171.846034:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019517056 00000100:00100000:2.0:1788909171.846037:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019517056 00000100:00100000:2.0:1788909171.846077:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788909171.846083:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019517056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.846156:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019517056:12345-0@lo:400:kworker.0 Request processed in 63us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909171.846162:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788909171.846186:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788909171.846192:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909171.846234:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019516544:0@lo:400:kworker.0 00010000:00080000:2.0:1788909171.846248:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d667800 x1875807019517056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909171.846259:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019517056:0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.846267:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019516416:0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.846278:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019516928:0@lo:400:kworker.0 00000100:00100000:0.0:1788909171.847189:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019516672:0@lo:400:kworker.0 00000100:00100000:0.0:1788909171.847256:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909171.847310:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788909171.847316:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905379a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019516288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909171.847352:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909171.847375:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019516800:0@lo:400:kworker.0 00000100:00100000:0.0:1788909171.847400:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909171.847447:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019516800 00000100:00100000:0.0:1788909171.847465:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019516800 00000100:00100000:0.0:1788909171.847504:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788909171.847512:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019516800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909171.847554:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019516800:12345-0@lo:400:kworker.0 Request processed in 43us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909171.847560:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788909171.847598:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d665180 x1875807019516800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909171.847611:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019516800:0@lo:400:kworker.0 00000100:00100000:1.0:1788909171.847883:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019516288 00000100:00100000:1.0:1788909171.847889:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019516288 00000100:00100000:1.0:1788909171.847931:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788909171.847939:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019516288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909171.847973:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909171.848009:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019516288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909171.848015:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788909171.848080:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905379a0a80 x1875807019516288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909171.848104:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905379a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019516288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909171.848482:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019516672 00000100:00100000:2.0:1788909171.848489:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019516672 00000100:00100000:2.0:1788909171.848546:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788909171.848553:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019516672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909171.848598:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019516672:12345-0@lo:400:kworker.0 Request processed in 46us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909171.848613:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788909171.849298:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909171.849471:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019516672:0@lo:400:kworker.0 00000100:00100000:3.0:1788909171.853558:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909171.854621:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004805504 00000100:00100000:1.0:1788909171.854702:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004805504 00000100:00100000:1.0:1788909171.854981:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1788909171.854993:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:9692:x1875807004805504:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:1.0:1788909171.855015:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909171.855052:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4454e expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909171.855268:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788909171.855509:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4454e expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.855525:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293600) 00010000:00010000:1.0:1788909171.855528:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788909171.855534:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4454e expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.855547:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692400, rc 0) 00000100:00100000:1.0:1788909171.856328:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:9692:x1875807004805504:12345-192.168.204.54@tcp:101:rm.0 Request processed in 1332us (2775us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788909171.856337:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1788909171.861669:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909171.861766:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004805632 00000100:00100000:0.0:1788909171.861780:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004805632 00000100:00100000:0.0:1788909171.861860:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788909171.861871:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:9692:x1875807004805632:12345-192.168.204.54@tcp:37:rm.0 00000100:00100000:0.0:1788909171.869789:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:9692:x1875807004805632:12345-192.168.204.54@tcp:37:rm.0 Request processed in 6880us (7093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909171.869805:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788909171.872739:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909171.872882:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004805888 00000100:00100000:2.0:1788909171.872896:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004805888 00000100:00100000:2.0:1788909171.872969:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788909171.872981:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051723b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:9692:x1875807004805888:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:2.0:1788909171.873407:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051723b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:9692:x1875807004805888:12345-192.168.204.54@tcp:35:rm.0 Request processed in 426us (678us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788909171.873415:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788909171.877422:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909171.877538:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004806144 00000100:00100000:1.0:1788909171.877548:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004806144 00000100:00100000:1.0:1788909171.877647:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1788909171.877660:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:9692:x1875807004806144:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:1.0:1788909171.877691:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909171.877716:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44555 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.877876:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d57b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.877890:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d57b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.877973:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d57b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909171.877986:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788909171.878249:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44555 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.878270:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d57b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44555 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.878437:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890520ac5300) 00010000:00010000:1.0:1788909171.878446:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788909171.878449:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692000, rc 0) 00000100:00100000:1.0:1788909171.878519:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:9692:x1875807004806144:12345-192.168.204.54@tcp:101:rm.0 Request processed in 862us (1106us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788909171.878528:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1788909171.882199:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909171.882371:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004806272 00000100:00100000:3.0:1788909171.882384:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004806272 00000100:00100000:3.0:1788909171.882443:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788909171.882453:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:9692:x1875807004806272:12345-192.168.204.54@tcp:41:rm.0 00000004:00000024:3.0:1788909171.882523:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788909171.882605:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:9692:x1875807004806272:12345-192.168.204.54@tcp:41:rm.0 Request processed in 152us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909171.882612:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788909171.885076:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909171.885170:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004806400 00000100:00100000:2.0:1788909171.885180:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004806400 00000100:00100000:2.0:1788909171.885478:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1788909171.885491:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:9692:x1875807004806400:12345-192.168.204.54@tcp:101:rm.0 00010000:00010000:2.0:1788909171.885513:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909171.885535:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d57c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4455c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.885604:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.885618:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.885630:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.885718:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.885748:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.885755:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.886030:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d57db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.886039:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d57db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.886056:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d57db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909171.886085:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788909171.886090:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909171.886166:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d57db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.886180:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d57db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.886189:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.886196:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.886203:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887381:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909171.887387:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887396:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887411:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890520ac5300) 00010000:00010000:2.0:1788909171.887414:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909171.887419:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887426:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d57cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887446:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887452:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887458:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887464:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909171.887466:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887471:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887495:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff890510293d00) 00010000:00010000:2.0:1788909171.887497:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909171.887501:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887507:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d57d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887765:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d57c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4455c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887780:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d57db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4455c expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909171.887788:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff890507e13b00) 00010000:00010000:2.0:1788909171.887790:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909171.887793:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10800, rc 0) 00000100:00100000:2.0:1788909171.887916:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:9692:x1875807004806400:12345-192.168.204.54@tcp:101:rm.0 Request processed in 2426us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909171.887935:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1788909171.898350:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909171.898658:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004806656 00000100:00100000:3.0:1788909171.898857:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004806656 00000100:00100000:3.0:1788909171.899337:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1788909171.899357:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:9692:x1875807004806656:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:3.0:1788909171.899438:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788909171.899475:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10800/0x733cfdd8721d57db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4455c expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.899499:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5787 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44540 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.899538:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff890507e13b00) 00010000:00010000:3.0:1788909171.900165:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d579c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44547 expref: 15 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.900179:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890520ac5300) 00010000:00010000:3.0:1788909171.900182:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909171.900216:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.900234:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.900248:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.900266:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.900273:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.900280:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.900472:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.900480:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909171.900496:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788909171.906050:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788909171.906080:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 253979968991ns, next at 254979962540ns, rc = 0 00010000:00010000:0.0:1788909171.906398:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906421:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906434:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906465:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906471:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906476:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906504:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788909171.906526:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906532:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906620:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906828:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909171.906834:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.906860:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909171.906868:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.906874:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c400 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909171.906878:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.906886:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.906899:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff890507e13700) 00010000:00010000:1.0:1788909171.906910:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788909171.906916:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.906922:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d57f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.906937:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909171.906938:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909171.906940:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909171.906981:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.906992:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff890507e13700) 00010000:00010000:0.0:1788909171.906994:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788909171.906997:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.907012:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d57f0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.907040:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.907046:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.907053:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.907058:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909171.907061:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.907066:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.907075:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890520ac5300) 00010000:00010000:0.0:1788909171.907077:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909171.907080:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.907085:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d57e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788909171.907094:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f65fca5 reply state 000000005cfa60af transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909171.907104:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788909171.907467:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:9692:x1875807004806656:12345-192.168.204.54@tcp:36:rm.0 Request processed in 8112us (9126us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788909171.907479:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788909171.914124:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909171.914494:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004806912 00000100:00100000:2.0:1788909171.914507:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004806912 00000100:00100000:2.0:1788909171.914591:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1788909171.914603:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:9692:x1875807004806912:12345-192.168.204.54@tcp:35:rm.0 00000100:00100000:2.0:1788909171.915346:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:9692:x1875807004806912:12345-192.168.204.54@tcp:35:rm.0 Request processed in 739us (1252us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788909171.915380:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00010000:00010000:1.0:1788909171.915618:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.915646:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.915655:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.915910:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909171.915918:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.915929:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.915947:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff890507e13500) 00010000:00010000:1.0:1788909171.915950:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909171.915955:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.915962:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9000/0x733cfdd8721d57e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909171.920426:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909171.920509:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004807168 00000100:00100000:1.0:1788909171.920520:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004807168 00000100:00100000:1.0:1788909171.920600:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1788909171.920613:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:9692:x1875807004807168:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:1.0:1788909171.920700:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788909171.920734:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d57b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44555 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.920758:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693000/0x733cfdd8721d5756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44532 expref: 15 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.920769:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890520ac5300) 00010000:00010000:1.0:1788909171.920786:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d5717 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44524 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.920795:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293600) 00010000:00010000:1.0:1788909171.920802:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788909171.920827:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.920852:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.920864:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.920878:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.920907:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.920914:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.921333:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.921343:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.921351:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909171.921931:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788909171.921949:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.921956:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.921964:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.921970:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909171.921974:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.921981:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.922000:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:1.0:1788909171.922003:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788909171.922007:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.922014:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692600/0x733cfdd8721d580c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.922037:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.922043:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.922048:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.922053:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909171.922056:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.922062:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.922068:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5500) 00010000:00010000:1.0:1788909171.922070:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909171.922072:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909171.922077:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692400/0x733cfdd8721d57fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788909171.922095:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001511cc17 reply state 0000000030158426 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909171.922104:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788909171.922224:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:9692:x1875807004807168:12345-192.168.204.54@tcp:36:rm.0 Request processed in 1612us (1809us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788909171.922232:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00010000:00010000:0.0:1788909171.926351:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.926374:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.926382:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.926389:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909171.926396:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.926405:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.926424:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890520ac5600) 00010000:00010000:0.0:1788909171.926427:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909171.926433:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909171.926438:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5805 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909172.421444:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909173.445421:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909174.471435:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788909175.397580:0:11616:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788909175.494602:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909175.896578:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909175.896716:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004807296 00000100:00100000:3.0:1788909175.896732:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004807296 00000100:00100000:3.0:1788909175.896880:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 242 00000100:00100000:3.0:1788909175.896897:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004807296:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909175.897007:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004807296:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 116us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909175.897016:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 242 00000100:00100000:3.0:1788909175.901342:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909175.901392:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909175.901399:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004807424 00000100:00100000:1.0:1788909175.901424:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004807424 00000100:00100000:3.0:1788909175.901432:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909175.901461:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004807680 00000100:00100000:3.0:1788909175.901466:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004807680 00000100:00100000:1.0:1788909175.901510:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:1.0:1788909175.901525:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2349:x1875807004807424:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909175.901569:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004807552 00000100:00100000:0.0:1788909175.901574:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004807552 00000100:00100000:0.0:1788909175.901621:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1788909175.901630:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2349:x1875807004807424:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909175.901632:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004807552:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909175.901679:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004807552:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 50us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909175.901686:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788909175.901970:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:3.0:1788909175.901981:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004807680:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909175.902014:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004807680:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909175.902021:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00080000:3.0:1788909175.902065:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788909175.902082:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909175.904920:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:1.0:1788909175.942408:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1788909175.942421:0:7152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 258016309799ns, next at 259016306509ns, rc = 0 00000100:00100000:1.0:1788909175.942437:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019517184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909175.942660:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909175.942778:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019517184 00000100:00100000:2.0:1788909175.942788:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019517184 00000100:00100000:2.0:1788909175.942868:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788909175.942880:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019517184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788909175.942919:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909175.942969:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019517184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909175.942976:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788909175.943023:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d665c00 x1875807019517184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788909175.943045:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909175.943049:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019517184:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788909176.269336:0:11665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd54cb9850 20000000:00000080:3.0:1788909176.269360:0:11665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890537adf800 uarg=0000000000000000 20000000:01000000:3.0:1788909176.269411:0:11665:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788909176.269510:0:11665:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788909176.269517:0:11665:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788909176.271374:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788909176.271533:0:11665:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788909176.279665:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788909176.279727:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788909176.279791:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788909176.279810:0:11665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788909176.279830:0:11665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.279851:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4450f expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.279861:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d56bc expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.279868:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d56ca expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.279876:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44516 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.279883:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d56df expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.279891:0:11665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.279931:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d56df expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.279947:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d56df expref: 18 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.279971:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517312:0@lo:104: 00000100:00100000:3.0:1788909176.280036:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788909176.280146:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44516 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.280158:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44516 expref: 12 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.280168:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517440:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909176.280234:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d56ca expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.280242:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d56ca expref: 18 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.280251:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517568:0@lo:104: 00000100:00100000:3.0:1788909176.280275:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788909176.280297:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d56bc expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.280305:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d56bc expref: 18 pid: 5816 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.280313:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517696:0@lo:104: 00000100:00100000:3.0:1788909176.280336:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788909176.280361:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4450f expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.280378:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4450f expref: 12 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.280386:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517824:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909176.280406:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537acdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788909176.280644:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788909176.280662:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019517312 00000100:00100000:0.0:1788909176.280672:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019517312 00000100:00100000:0.0:1788909176.280720:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019517568 00000100:00100000:0.0:1788909176.280724:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019517568 00000100:00100000:0.0:1788909176.280740:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019517696 00000100:00100000:0.0:1788909176.280743:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019517696 00000100:00100000:0.0:1788909176.280756:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788909176.280766:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+5:11665:x1875807019517312:12345-0@lo:104: 00010000:00010000:0.0:1788909176.280782:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.280875:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788909176.280884:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+5:11665:x1875807019517312:12345-0@lo:104: Request processed in 119us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909176.280894:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788909176.280928:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788909176.280962:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+4:11665:x1875807019517568:12345-0@lo:104: 00010000:00010000:0.0:1788909176.280974:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281026:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788909176.281034:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+4:11665:x1875807019517568:12345-0@lo:104: Request processed in 75us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909176.281057:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788909176.281095:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788909176.281105:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:11665:x1875807019517696:12345-0@lo:104: 00010000:00010000:0.0:1788909176.281148:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281204:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788909176.281211:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:de4f34ee-762f-480d-9428-329e99488659+3:11665:x1875807019517696:12345-0@lo:104: Request processed in 108us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909176.281219:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788909176.281278:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788909176.281286:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281297:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ca00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909176.281304:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281316:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909176.281325:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909176.281333:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788909176.281374:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281383:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909176.281432:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281444:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890504d9ca00/0x733cfdd8721d56df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d56e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281465:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788909176.281471:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281480:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909176.281485:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281494:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909176.281503:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909176.281510:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788909176.281531:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281540:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909176.281559:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281570:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89052dc11200/0x733cfdd8721d56ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d56d1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281584:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909176.281602:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281612:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693e00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909176.281617:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281630:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909176.281639:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909176.281647:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788909176.281673:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281682:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909176.281694:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281702:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501693e00/0x733cfdd8721d56bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d56c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.281721:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909176.281725:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909176.281728:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909176.281749:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788909176.281824:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019517952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788909176.281882:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909176.281945:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019517952 00000100:00100000:0.0:1788909176.281966:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019517952 00010000:00010000:0.0:1788909176.282005:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d56df expref: 19 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909176.282041:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788909176.282051:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019517952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788909176.282078:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909176.282088:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d56df expref: 19 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.282105:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d56df expref: 19 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.282162:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909176.282212:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019517952:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909176.282221:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788909176.282273:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019517952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909176.283434:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019518080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909176.283491:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909176.283551:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909176.283557:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019518208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909176.283580:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909176.283613:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019518080 00000100:00100000:2.0:1788909176.283618:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019518080 00010000:00010000:2.0:1788909176.283641:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d56ca expref: 19 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909176.283664:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019518208 00000100:00100000:2.0:1788909176.283667:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019518208 00010000:00010000:2.0:1788909176.283676:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d56bc expref: 20 pid: 5816 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909176.283708:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788909176.283716:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+20:3285:x1875807019518080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909176.283727:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909176.283732:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d56ca expref: 20 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909176.283741:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d56ca expref: 20 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909176.283760:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909176.283789:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+20:3285:x1875807019518080:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909176.283797:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788909176.283812:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788909176.283818:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019518208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909176.283826:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909176.283830:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d56bc expref: 19 pid: 5816 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909176.283838:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d56bc expref: 19 pid: 5816 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909176.283847:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909176.283867:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019518208:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909176.283873:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788909176.283933:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019518208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909176.283951:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019518080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909176.284000:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909176.284006:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909176.284208:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9ce00/0x733cfdd8721d56e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d56df expref: 18 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.284221:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517312:0@lo:104: 00010000:00010000:3.0:1788909176.284231:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc11800/0x733cfdd8721d56d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d56ca expref: 17 pid: 5815 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.284239:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517568:0@lo:104: 00010000:00010000:3.0:1788909176.284247:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d56c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d56bc expref: 16 pid: 5816 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.284254:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517696:0@lo:104: 00000100:00100000:0.0:1788909176.292507:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517440:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909176.296003:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909176.296043:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909176.296169:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004807808 00000100:00100000:3.0:1788909176.296179:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004807808 00010000:00010000:3.0:1788909176.296220:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44516 expref: 13 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.296246:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004807936 00000100:00100000:3.0:1788909176.296248:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004807936 00010000:00010000:3.0:1788909176.296258:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4450f expref: 14 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909176.296276:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788909176.296298:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986c0547-f072-453e-bddd-5efe6ff9e6ca+14:2349:x1875807004807808:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909176.296312:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909176.296318:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44516 expref: 14 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296329:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44516 expref: 14 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296348:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc11a00/0x733cfdd8721d56d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44516 expref: 14 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296363:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909176.296413:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004807808:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 116us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909176.296420:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788909176.296437:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1788909176.296443:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:2349:x1875807004807936:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909176.296453:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909176.296457:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4450f expref: 12 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296466:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4450f expref: 12 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296478:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296486:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296506:0:8451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296513:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296520:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296527:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296533:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad8200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909176.296537:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296544:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296553:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909176.296561:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909176.296581:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:2349:x1875807004807936:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 138us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909176.296588:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00010000:00010000:0.0:1788909176.296950:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d56b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4450f expref: 11 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909176.296962:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875807019517824:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909176.297000:0:11665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.297010:0:11665:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.297026:0:11665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909176.297033:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5813 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909176.518493:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909176.966139:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019518336:0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.966258:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909176.966328:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019518848:0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.966359:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909176.966406:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788909176.966414:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019518464:0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.966443:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909176.966462:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019518976:0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.966490:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909176.966529:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019518592:0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.966609:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909176.966628:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909176.966633:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019518720:0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.966655:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909176.966686:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019518336 00000100:00100000:2.0:1788909176.966694:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019518336 00000100:00100000:2.0:1788909176.966740:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788909176.966749:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:3283:x1875807019518336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.966796:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+16:3283:x1875807019518336:12345-0@lo:400:kworker.0 Request processed in 49us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909176.966814:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788909176.966846:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019518976 00000100:00100000:2.0:1788909176.966850:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019518976 00000100:00100000:2.0:1788909176.966883:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019518720 00000100:00100000:2.0:1788909176.966887:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019518720 00000100:00100000:2.0:1788909176.966907:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788909176.966913:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019518976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.966945:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019518976:12345-0@lo:400:kworker.0 Request processed in 32us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909176.966951:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788909176.966963:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788909176.966969:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019518720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.967001:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019518720:12345-0@lo:400:kworker.0 Request processed in 32us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909176.967006:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788909176.967028:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788909176.967079:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890403558700 x1875807019518720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909176.967093:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019518720:0@lo:400:kworker.0 00010000:00080000:2.0:1788909176.967153:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d6da300 x1875807019518976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909176.967162:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019518976:0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.967170:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019518336:0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.967216:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019518848 00000100:00100000:2.0:1788909176.967225:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019518848 00000100:00100000:2.0:1788909176.967259:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019518464 00000100:00100000:2.0:1788909176.967262:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019518464 00000100:00100000:2.0:1788909176.967274:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019518592 00000100:00100000:2.0:1788909176.967277:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019518592 00000100:00100000:2.0:1788909176.967291:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788909176.967298:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019518848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909176.967329:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788909176.967341:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019518848:12345-0@lo:400:kworker.0 Request processed in 44us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909176.967349:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788909176.967352:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905379a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019519104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909176.967365:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788909176.967372:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019518464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.967407:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019518464:12345-0@lo:400:kworker.0 Request processed in 35us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909176.967415:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788909176.967416:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909176.967431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788909176.967440:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019518592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909176.967464:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019519104 00000100:00100000:1.0:1788909176.967470:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019519104 00000100:00100000:2.0:1788909176.967472:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019518592:12345-0@lo:400:kworker.0 Request processed in 34us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909176.967480:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788909176.967508:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909176.967509:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788909176.967520:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019519104:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909176.967547:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019518464:0@lo:400:kworker.0 00000100:00100000:2.0:1788909176.967559:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019518848:0@lo:400:kworker.0 00002000:00000024:1.0:1788909176.967567:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909176.967615:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019519104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909176.967622:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788909176.967628:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019518592:0@lo:400:kworker.0 00010000:00080000:1.0:1788909176.967662:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905379a1500 x1875807019519104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909176.967680:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905379a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019519104:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788909177.011607:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:1.0:1788909177.011692:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788909177.011821:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788909177.012088:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909177.012132:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019519232:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788909177.012210:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909177.012307:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019519232 00000100:00100000:0.0:1788909177.012315:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019519232 00000004:00080000:3.0:1788909177.012424:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788909177.012525:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788909177.012536:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019519232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788909177.012565:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788909177.012597:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa09673, atime: 0x6aa09673, ctime: 0x6aa09673, blocks: 0x1 00010000:00010000:2.0:1788909177.012605:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.012621:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=259s v=(0 0) 00010000:00010000:2.0:1788909177.012625:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909177.012631:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.012648:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.012658:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.012666:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.012691:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909177.012930:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909177.012939:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.012963:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909177.012969:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.012979:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.013003:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.013010:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d581a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.013036:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909177.013039:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909177.013040:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909177.013573:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1875807019519232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1038us (1360us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788909177.013582:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788909177.013619:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788909177.013698:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890510387480/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788909177.013706:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019519232:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788909177.541697:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909177.753643:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909177.754815:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004808064 00000100:00100000:3.0:1788909177.754833:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004808064 00000100:00100000:3.0:1788909177.754994:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:3.0:1788909177.755007:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:5591:x1875807004808064:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909177.755044:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909177.755078:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5821 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a44563 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.755160:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44563 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.755174:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44563 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.755187:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad8200, rc 0) 00000100:00100000:3.0:1788909177.755298:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004808064:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 293us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909177.755307:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 244 00000100:00100000:2.0:1788909177.758975:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909177.759380:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004808192 00000100:00100000:1.0:1788909177.759394:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004808192 00000100:00100000:1.0:1788909177.759828:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 245 00000100:00100000:1.0:1788909177.759842:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004808192:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788909177.760344:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004808192:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 503us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909177.760354:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 245 00000100:00100000:0.0:1788909177.762568:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909177.762774:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004808320 00000100:00100000:3.0:1788909177.762844:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004808320 00000100:00100000:3.0:1788909177.762903:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 246 00000100:00100000:3.0:1788909177.762919:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004808320:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909177.763838:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004808320:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 905us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909177.763856:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 246 00000100:00100000:0.0:1788909177.767307:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909177.767702:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004808448 00000100:00100000:1.0:1788909177.767717:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004808448 00000100:00100000:1.0:1788909177.767856:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:1.0:1788909177.767869:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:9962:x1875807004808448:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788909177.768310:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:9962:x1875807004808448:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 442us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909177.768320:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 247 00000100:00100000:2.0:1788909177.771681:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909177.772070:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004808576 00000100:00100000:3.0:1788909177.772084:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004808576 00000100:00100000:3.0:1788909177.772221:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 248 00000100:00100000:3.0:1788909177.772233:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:9962:x1875807004808576:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788909177.772569:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:9962:x1875807004808576:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 337us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909177.772579:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 248 00000100:00100000:0.0:1788909177.778164:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909177.778541:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004808704 00000100:00100000:1.0:1788909177.778554:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004808704 00000100:00100000:1.0:1788909177.778635:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 249 00000100:00100000:1.0:1788909177.778657:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:5591:x1875807004808704:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788909177.778681:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909177.778711:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501692400/0x733cfdd8721d5828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a4456a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909177.778855:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501692400/0x733cfdd8721d5828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4456a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909177.778871:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501692400/0x733cfdd8721d5828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4456a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909177.778884:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692400, rc 0) 00000100:00100000:1.0:1788909177.778980:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004808704:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 335us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909177.778988:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 249 00000100:00100000:0.0:1788909177.784284:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909177.784463:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004808832 00000100:00100000:3.0:1788909177.784497:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004808832 00000100:00100000:3.0:1788909177.784570:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 250 00000100:00100000:3.0:1788909177.784582:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004808832:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909177.786450:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004808832:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 1856us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909177.786468:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 250 00000100:00100000:3.0:1788909177.791864:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909177.792081:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004808960 00000100:00100000:2.0:1788909177.792093:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004808960 00000100:00100000:2.0:1788909177.792334:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 251 00000100:00100000:2.0:1788909177.792347:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004808960:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909177.792680:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:5591:x1875807004808960:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 335us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909177.792688:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 251 00000100:00100000:0.0:1788909177.798771:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909177.798926:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004809088 00000100:00100000:3.0:1788909177.798944:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004809088 00000100:00100000:3.0:1788909177.799012:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00100000:3.0:1788909177.799023:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:9965:x1875807004809088:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788909177.799405:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:9965:x1875807004809088:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 382us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909177.799415:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 252 00000100:00100000:0.0:1788909177.807887:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909177.808045:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004809216 00000100:00100000:2.0:1788909177.808059:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004809216 00000100:00100000:2.0:1788909177.808156:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 253 00000100:00100000:2.0:1788909177.808169:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:9965:x1875807004809216:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788909177.808874:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:9965:x1875807004809216:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 704us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909177.808884:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 253 10000000:01000000:0.0:1788909177.864617:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788909177.864630:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905375be800 from 7 10000000:01000000:0.0:1788909177.864637:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788909177.864926:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909177.864942:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909177.864957:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909177.864994:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019519360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788909177.865273:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909177.865357:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506204780 going to sleep for 11 seconds 00000100:00100000:1.0:1788909177.867540:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019519360 00000100:00100000:1.0:1788909177.867559:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019519360 00000100:00100000:1.0:1788909177.867646:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788909177.867659:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+16:5820:x1875807019519360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788909177.867679:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909177.867723:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890501692600/0x733cfdd8721d5836 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d582f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909177.867763:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890501692600/0x733cfdd8721d5836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d582f expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909177.867879:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890501692600/0x733cfdd8721d5836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d582f expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909177.867891:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692600, rc 0) 00000100:00100000:1.0:1788909177.868011:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019519360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909177.868020:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788909177.868273:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019519360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788909177.868297:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909177.868307:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909177.868401:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019519488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909177.868441:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909177.868488:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506204780 going to sleep for 11 seconds 00000100:00100000:2.0:1788909177.868767:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019519488 00000100:00100000:2.0:1788909177.868774:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019519488 00000100:00100000:2.0:1788909177.868818:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788909177.868828:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905085ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019519488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909177.870594:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905085ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019519488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1758us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909177.870614:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788909177.871277:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019519488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909177.871366:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019519616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909177.871461:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909177.871518:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506204780 going to sleep for 11 seconds 00000100:00100000:2.0:1788909177.872198:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019519616 00000100:00100000:2.0:1788909177.872210:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019519616 00000100:00100000:2.0:1788909177.872285:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788909177.872295:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019519616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909177.872558:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019519616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909177.872567:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788909177.873056:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019519616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909177.873859:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11679:1875807019519744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909177.873927:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909177.873974:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905062043c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909177.874771:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019519744 00000100:00100000:2.0:1788909177.874782:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019519744 00000100:00100000:2.0:1788909177.874845:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788909177.874857:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:11679:x1875807019519744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909177.875425:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:11679:x1875807019519744:12345-0@lo:502:llog_process_th.0 Request processed in 568us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909177.875434:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788909177.875837:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11679:1875807019519744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788909177.875881:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909177.875894:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909177.875898:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788909177.875908:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8905375be800 00000020:00000080:0.0:1788909177.875921:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788909177.876865:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11679:1875807019519872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909177.876977:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909177.877174:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905062043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909177.878232:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019519872 00000100:00100000:1.0:1788909177.878252:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019519872 00000100:00100000:1.0:1788909177.878330:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788909177.878345:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050696c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:11679:x1875807019519872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788909177.878633:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050696c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+17:11679:x1875807019519872:12345-0@lo:502:llog_process_th.0 Request processed in 292us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909177.878644:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788909177.878685:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11679:1875807019519872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909177.878744:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909177.878756:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909177.878759:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788909177.878765:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788909177.880352:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788909177.880390:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788909177.880402:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909177.880414:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909177.880426:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788909177.880444:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905068d9800 from 7 10000000:01000000:1.0:1788909177.880447:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788909177.880724:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909177.880733:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909177.880745:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909177.880772:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905379a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788909177.880841:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909177.880894:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788909177.881066:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019520000 00000100:00100000:2.0:1788909177.881078:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019520000 00000100:00100000:2.0:1788909177.881163:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788909177.881174:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+17:5820:x1875807019520000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909177.881192:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909177.881212:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc10800/0x733cfdd8721d5844 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d583d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.881245:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10800/0x733cfdd8721d5844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d583d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.881257:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc10800/0x733cfdd8721d5844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d583d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.881268:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10800, rc 0) 00000100:00100000:2.0:1788909177.881336:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019520000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909177.881351:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788909177.881409:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905379a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909177.881427:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.881438:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909177.881506:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909177.881535:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909177.881559:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89051e8cbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788909177.881776:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019520128 00000100:00100000:1.0:1788909177.881785:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019520128 00000100:00100000:1.0:1788909177.881893:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788909177.881904:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019520128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788909177.882239:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019520128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909177.882246:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788909177.884217:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909177.884305:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909177.884415:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909177.884524:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff89051e8cbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909177.884570:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019520256 00000100:00100000:3.0:1788909177.884578:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019520256 00000100:00100000:3.0:1788909177.884740:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788909177.884750:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019520256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909177.888640:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019520256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3877us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909177.888661:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788909177.888772:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909177.889295:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11682:1875807019520384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909177.889396:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909177.889469:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905062040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909177.889537:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019520384 00000100:00100000:3.0:1788909177.889546:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019520384 00000100:00100000:3.0:1788909177.889631:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788909177.889641:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:11682:x1875807019520384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909177.889919:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+18:11682:x1875807019520384:12345-0@lo:502:llog_process_th.0 Request processed in 276us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909177.889927:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788909177.890073:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11682:1875807019520384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788909177.890107:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788909177.890166:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909177.890169:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788909177.890177:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8905068d9800 00000020:00000080:2.0:1788909177.890181:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788909177.890662:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11682:1875807019520512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909177.890715:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909177.896257:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537acde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909177.896565:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019520512 00000100:00100000:0.0:1788909177.896580:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019520512 00000100:00100000:0.0:1788909177.896644:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788909177.896656:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:11682:x1875807019520512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909177.897169:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:11682:x1875807019520512:12345-0@lo:502:llog_process_th.0 Request processed in 513us (6452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909177.897178:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788909177.898382:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11682:1875807019520512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788909177.898446:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909177.898457:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909177.898459:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788909177.898465:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788909177.898589:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788909177.898617:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788909177.898630:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.898642:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909177.898654:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788909177.898658:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905103af000 from 7 10000000:01000000:3.0:1788909177.898661:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788909177.898703:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.898712:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909177.898793:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909177.898822:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788909177.898904:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909177.898951:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905066006c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909177.899142:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019520640 00000100:00100000:0.0:1788909177.899150:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019520640 00000100:00100000:0.0:1788909177.899195:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788909177.899206:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+18:5820:x1875807019520640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788909177.899223:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909177.899238:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890504d9d800/0x733cfdd8721d5852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d584b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909177.899266:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890504d9d800/0x733cfdd8721d5852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d584b expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909177.899279:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890504d9d800/0x733cfdd8721d5852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d584b expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909177.899301:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d800, rc 0) 00000100:00100000:0.0:1788909177.899343:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019520640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909177.899351:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788909177.903038:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909177.903082:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.903098:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909177.903227:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909177.903315:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909177.903370:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890510b75300 going to sleep for 11 seconds 00000100:00100000:3.0:1788909177.903593:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019520768 00000100:00100000:3.0:1788909177.903602:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019520768 00000100:00100000:3.0:1788909177.903664:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788909177.903676:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019520768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909177.904973:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019520768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1291us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909177.904985:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788909177.905224:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909177.905290:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909177.905346:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909177.906349:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506600180 going to sleep for 11 seconds 00000040:00080000:1.0:1788909177.910385:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788909177.911258:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019520896 00000100:00100000:0.0:1788909177.911276:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019520896 00000100:00100000:0.0:1788909177.911397:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788909177.911410:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019520896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909177.913330:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:5820:x1875807019520896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1909us (7969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909177.913349:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788909177.913399:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:de4f34ee-762f-480d-9428-329e99488659:5820:1875807019520896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909177.913727:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11684:1875807019521024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909177.913833:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909177.919205:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537acde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909177.922179:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019521024 00000100:00100000:3.0:1788909177.922209:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019521024 00000100:00100000:3.0:1788909177.922323:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788909177.922336:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:11684:x1875807019521024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909177.922714:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:11684:x1875807019521024:12345-0@lo:502:llog_process_th.0 Request processed in 379us (8881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909177.923870:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788909177.924247:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11684:1875807019521024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909177.924311:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909177.924331:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909177.924336:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788909177.924350:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8905103af000 00000020:00000080:3.0:1788909177.924367:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788909177.924522:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11684:1875807019521152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909177.924606:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909177.924732:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506600e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909177.924822:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019521152 00000100:00100000:0.0:1788909177.924831:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019521152 00000100:00100000:0.0:1788909177.924926:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788909177.924939:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:11684:x1875807019521152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909177.925330:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:11684:x1875807019521152:12345-0@lo:502:llog_process_th.0 Request processed in 393us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909177.925340:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788909177.925494:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:de4f34ee-762f-480d-9428-329e99488659:11684:1875807019521152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788909177.925523:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909177.925531:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909177.925532:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788909177.925537:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788909177.925611:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788909177.925630:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788909177.925648:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909177.925668:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909178.569763:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788909178.949916:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788909179.589819:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909180.615035:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909181.018009:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909181.018054:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909181.018095:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909181.018152:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909181.018199:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004809600 00000100:00100000:2.0:1788909181.018212:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004809600 00000100:00100000:1.0:1788909181.018225:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004809344 00000100:00100000:1.0:1788909181.018233:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004809344 00000100:00100000:1.0:1788909181.018281:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 269 00000100:00100000:2.0:1788909181.018286:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1788909181.018296:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2348:x1875807004809344:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909181.018299:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004809600:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909181.018395:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004809472 00000100:00100000:3.0:1788909181.018400:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004809472 00000100:00100000:3.0:1788909181.018431:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004809728 00000100:00100000:3.0:1788909181.018434:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004809728 00000100:00100000:3.0:1788909181.018452:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:3.0:1788909181.018460:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004809472:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909181.018610:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:0.0:1788909181.018621:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2348:x1875807004809728:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909181.018691:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004809600:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 396us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909181.018699:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00080000:2.0:1788909181.018722:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788909181.018726:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909181.021288:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2348:x1875807004809344:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 2984us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909181.021318:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 269 00000100:00100000:3.0:1788909181.022212:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2348:x1875807004809472:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 3747us (4210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909181.022224:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1788909181.025638:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae3d4805-3977-4f79-88af-684dce002b2f+5:2348:x1875807004809728:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 7008us (7570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909181.025652:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1788909181.061457:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788909181.061478:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019521280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909181.061548:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909181.061735:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019521280 00000100:00100000:2.0:1788909181.061744:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019521280 00000100:00100000:2.0:1788909181.061828:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788909181.061838:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875807019521280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788909181.061879:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909181.061925:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875807019521280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909181.061932:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788909181.062010:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019521280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788909181.062254:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788909181.637302:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909182.087309:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909182.087341:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905379a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019521408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909182.087444:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909182.087457:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019521920:0@lo:400:kworker.0 00000100:00100000:0.0:1788909182.087515:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909182.087577:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788909182.087584:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019521792:0@lo:400:kworker.0 00000100:00100000:0.0:1788909182.087613:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909182.087718:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019521792 00000100:00100000:0.0:1788909182.087727:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019521792 00000100:00100000:0.0:1788909182.087788:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788909182.087799:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019521792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909182.087862:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019521792:12345-0@lo:400:kworker.0 Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909182.087870:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788909182.088265:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019521536:0@lo:400:kworker.0 00000100:00100000:0.0:1788909182.088377:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019521792:0@lo:400:kworker.0 00000100:00100000:0.0:1788909182.088432:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019521664:0@lo:400:kworker.0 00000100:00100000:3.0:1788909182.088540:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909182.088571:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019522048:0@lo:400:kworker.0 00000100:00100000:3.0:1788909182.088593:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788909182.088661:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909182.088683:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019522048 00000100:00100000:1.0:1788909182.088684:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019521408 00000100:00100000:3.0:1788909182.088689:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019522048 00000100:00100000:1.0:1788909182.088691:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019521408 00000100:00100000:3.0:1788909182.088739:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788909182.088745:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788909182.088751:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019522048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909182.088759:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019521408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909182.088797:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019522048:12345-0@lo:400:kworker.0 Request processed in 50us (202us total) trans 0 rc 0/0 00002000:00000024:1.0:1788909182.088798:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909182.088809:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788909182.088843:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019522048:0@lo:400:kworker.0 00000100:00100000:1.0:1788909182.088854:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019521408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909182.088864:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788909182.088887:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788909182.088891:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788909182.088922:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905379a1c00 x1875807019521408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909182.088941:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905379a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019521408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909182.089302:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909182.089340:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019522176:0@lo:400:kworker.0 00000100:00100000:0.0:1788909182.089369:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909182.089408:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019521920 00000100:00100000:0.0:1788909182.089413:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019521920 00000100:00100000:3.0:1788909182.089598:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019522176 00000100:00100000:3.0:1788909182.089603:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019522176 00000100:00100000:3.0:1788909182.089625:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788909182.089632:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875807019521920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909182.089673:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875807019521920:12345-0@lo:400:kworker.0 Request processed in 42us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909182.089680:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788909182.089698:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788909182.089704:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019522176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909182.089730:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019522176:12345-0@lo:400:kworker.0 Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909182.089736:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788909182.090967:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019521664 00000100:00100000:1.0:1788909182.091054:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019521664 00000100:00100000:1.0:1788909182.091138:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788909182.091150:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019521664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909182.091261:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019521664:12345-0@lo:400:kworker.0 Request processed in 113us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909182.091269:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788909182.091331:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019521920:0@lo:400:kworker.0 00000100:00100000:2.0:1788909182.096132:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019521664:0@lo:400:kworker.0 00010000:00080000:2.0:1788909182.096163:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052d6f9500 x1875807019522176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788909198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909182.096174:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019522176:0@lo:400:kworker.0 00000100:00100000:0.0:1788909182.097697:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019521536 00000100:00100000:0.0:1788909182.097710:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019521536 00000100:00100000:0.0:1788909182.097774:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788909182.097784:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019521536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909182.097869:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019521536:12345-0@lo:400:kworker.0 Request processed in 86us (9328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909182.097877:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788909182.098094:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019521536:0@lo:400:kworker.0 00000001:00080000:3.0:1788909182.144044:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788909182.661417:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909183.685515:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909184.709872:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909185.733382:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909186.137212:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909186.137260:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909186.137284:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909186.137307:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909186.137500:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004809856 00000100:00100000:2.0:1788909186.137510:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004809856 00000100:00100000:2.0:1788909186.137557:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 271 00000100:00100000:2.0:1788909186.137576:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2347:x1875807004809856:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909186.137644:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2347:x1875807004809856:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 79us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909186.137652:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 271 00000100:00100000:2.0:1788909186.137775:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004809984 00000100:00100000:2.0:1788909186.137779:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004809984 00000100:00100000:2.0:1788909186.137808:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004810240 00000100:00100000:2.0:1788909186.137811:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004810240 00000100:00100000:2.0:1788909186.137826:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:2.0:1788909186.137831:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004809984:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909186.137864:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004809984:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909186.137883:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:2.0:1788909186.137895:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:2.0:1788909186.137901:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004810240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909186.137942:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2347:x1875807004810240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 41us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909186.137948:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:0.0:1788909186.138225:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004810112 00000100:00100000:0.0:1788909186.138230:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004810112 00000100:00100000:0.0:1788909186.138261:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:0.0:1788909186.138268:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004810112:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909186.138302:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004810112:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909186.138309:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00080000:1.0:1788909186.138555:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788909186.138560:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909186.181519:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788909186.181773:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019522304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788909186.181843:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909186.182947:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019522304 00000100:00100000:2.0:1788909186.182960:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019522304 00000100:00100000:2.0:1788909186.183086:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788909186.183096:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019522304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788909186.183148:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909186.183266:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019522304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909186.183273:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788909186.183677:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909186.183727:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788909186.183734:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890510387480, transno 4294967300 00000100:00100000:0.0:1788909186.183803:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019522304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788909186.757231:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909187.205673:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788909187.205703:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905379a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019522432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909187.205793:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909187.205903:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019522432 00000100:00100000:2.0:1788909187.205912:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019522432 00000100:00100000:2.0:1788909187.205979:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788909187.205992:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019522432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788909187.206028:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909187.206081:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019522432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909187.206088:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788909187.206312:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788909187.206345:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905379a1c00 x1875807019522432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909187.206362:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905379a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019522432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909187.208050:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019522816:0@lo:400:kworker.0 00000100:00100000:3.0:1788909187.208148:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909187.208188:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788909187.208194:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019522944:0@lo:400:kworker.0 00000100:00100000:3.0:1788909187.208224:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909187.208261:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019522816 00000100:00100000:1.0:1788909187.208262:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019522944 00000100:00100000:3.0:1788909187.208270:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019522816 00000100:00100000:1.0:1788909187.208270:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019522944 00000100:00100000:3.0:1788909187.208326:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788909187.208326:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788909187.208341:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019522816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909187.208342:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019522944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909187.208407:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019522816:12345-0@lo:400:kworker.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909187.208410:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019522944:12345-0@lo:400:kworker.0 Request processed in 73us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909187.208418:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788909187.208429:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788909187.208456:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909187.208490:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019522944:0@lo:400:kworker.0 00000100:00100000:3.0:1788909187.208500:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019522816:0@lo:400:kworker.0 00000100:00100000:3.0:1788909187.208545:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019522688:0@lo:400:kworker.0 00000100:00100000:0.0:1788909187.208720:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019522560:0@lo:400:kworker.0 00000100:00100000:0.0:1788909187.208759:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909187.208794:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019523072:0@lo:400:kworker.0 00000100:00100000:0.0:1788909187.208816:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909187.208875:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019522560 00000100:00100000:0.0:1788909187.208880:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019522560 00000100:00100000:0.0:1788909187.208921:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788909187.208929:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019522560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909187.208969:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019522560:12345-0@lo:400:kworker.0 Request processed in 42us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909187.208983:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788909187.209027:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019523072 00000100:00100000:0.0:1788909187.209032:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019523072 00000100:00100000:0.0:1788909187.209073:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788909187.209082:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019523072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909187.209143:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019523072:12345-0@lo:400:kworker.0 Request processed in 63us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909187.209150:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788909187.209177:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909187.209200:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019522560:0@lo:400:kworker.0 00000100:00100000:0.0:1788909187.209213:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019523072:0@lo:400:kworker.0 00000100:00100000:3.0:1788909187.209637:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909187.209812:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019522688 00000100:00100000:0.0:1788909187.209816:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019522688 00000100:00100000:0.0:1788909187.209892:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788909187.209899:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019522688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909187.209952:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019522688:12345-0@lo:400:kworker.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909187.209959:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788909187.211304:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019522688:0@lo:400:kworker.0 00010000:00010000:0.0:1788909187.781323:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788909188.165913:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788909188.805880:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909189.829581:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909190.854091:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909191.266226:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909191.266280:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909191.266312:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909191.266349:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909191.266351:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004810368 00000100:00100000:1.0:1788909191.266361:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004810368 00000100:00100000:2.0:1788909191.266378:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004810496 00000100:00100000:2.0:1788909191.266380:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004810496 00000100:00100000:1.0:1788909191.266415:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 273 00000100:00100000:2.0:1788909191.266416:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004810752 00000100:00100000:2.0:1788909191.266418:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004810752 00000100:00100000:1.0:1788909191.266424:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004810368:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909191.266435:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:2.0:1788909191.266442:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004810496:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909191.266493:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004810496:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909191.266501:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:0.0:1788909191.266511:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:0.0:1788909191.266520:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004810752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:2.0:1788909191.266521:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909191.266909:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004810368:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 481us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909191.266916:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 273 00000100:00100000:3.0:1788909191.267002:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004810624 00000100:00100000:0.0:1788909191.267016:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004810752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 494us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909191.267017:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004810624 00000100:00100000:0.0:1788909191.267030:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:3.0:1788909191.267430:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788909191.268306:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004810624:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909191.268436:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004810624:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 996us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909191.268446:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00080000:1.0:1788909191.274107:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909191.302083:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788909191.302132:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019523200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788909191.302285:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909191.303959:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019523200 00000100:00100000:2.0:1788909191.303972:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019523200 00000100:00100000:2.0:1788909191.304144:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788909191.304155:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019523200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788909191.304194:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909191.304347:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019523200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909191.304355:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788909191.304593:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909191.304655:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019523200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788909191.877328:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909192.325450:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019523328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909192.325524:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909192.325581:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788909192.325587:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019523456:0@lo:400:kworker.0 00000100:00100000:3.0:1788909192.325614:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909192.325645:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019523456 00000100:00100000:3.0:1788909192.325650:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019523456 00000100:00100000:2.0:1788909192.325670:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019523328 00000100:00100000:2.0:1788909192.325677:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019523328 00000100:00100000:0.0:1788909192.325791:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019523968:0@lo:400:kworker.0 00000100:00100000:0.0:1788909192.325823:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909192.325846:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788909192.326102:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019523840:0@lo:400:kworker.0 00000100:00100000:0.0:1788909192.326153:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909192.327321:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788909192.327339:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019523456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909192.327402:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019523456:12345-0@lo:400:kworker.0 Request processed in 71us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909192.327421:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788909192.327493:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019523456:0@lo:400:kworker.0 00000100:00100000:0.0:1788909192.327600:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019523968 00000100:00100000:0.0:1788909192.327608:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019523968 00000100:00100000:2.0:1788909192.327611:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788909192.327621:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788909192.327623:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019523328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909192.327631:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788909192.327656:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788909192.327666:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019523968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909192.327712:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019523968:12345-0@lo:400:kworker.0 Request processed in 47us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909192.327720:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00002000:00000024:2.0:1788909192.327721:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788909192.327773:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019523584:0@lo:400:kworker.0 00000100:00100000:2.0:1788909192.327788:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019523328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909192.327796:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788909192.327815:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788909192.327835:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905064d6a00 x1875807019523328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909192.327845:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788909192.327855:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89051175fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019523712:0@lo:400:kworker.0 00000100:00100000:2.0:1788909192.327856:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019523328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909192.327875:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019523840 00000100:00100000:3.0:1788909192.327881:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019523840 00000100:00080000:2.0:1788909192.327894:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788909192.327900:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788909192.327912:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788909192.327921:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019523840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909192.327954:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019523840:12345-0@lo:400:kworker.0 Request processed in 35us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909192.327961:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788909192.327990:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019523584 00000100:00100000:3.0:1788909192.327994:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019523584 00000100:00100000:3.0:1788909192.328014:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788909192.328020:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019523584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909192.328050:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019523584:12345-0@lo:400:kworker.0 Request processed in 30us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909192.328056:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788909192.328173:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909192.328200:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019523584:0@lo:400:kworker.0 00000100:00100000:0.0:1788909192.328220:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019523712 00000100:00100000:0.0:1788909192.328224:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019523712 00000100:00100000:0.0:1788909192.328250:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788909192.328256:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019523712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909192.328300:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019523712:12345-0@lo:400:kworker.0 Request processed in 43us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909192.328307:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788909192.328325:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909192.328343:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019523840:0@lo:400:kworker.0 00000100:00100000:0.0:1788909192.328352:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019523968:0@lo:400:kworker.0 00000100:00100000:0.0:1788909192.328438:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89051175fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019523712:0@lo:400:kworker.0 00010000:00010000:0.0:1788909192.901503:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909193.926657:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909194.949473:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909195.973578:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909196.381549:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909196.381599:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909196.381666:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004811008 00000100:00100000:3.0:1788909196.381690:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004811008 00000100:00100000:1.0:1788909196.381697:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004810880 00000100:00100000:1.0:1788909196.381704:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004810880 00000100:00100000:3.0:1788909196.381764:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:3.0:1788909196.381776:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004811008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:0.0:1788909196.381827:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909196.381846:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2349:x1875807004811008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909196.381855:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:1.0:1788909196.382444:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 275 00000100:00100000:1.0:1788909196.382456:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004810880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909196.382516:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004810880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 63us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909196.382523:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 275 00000100:00100000:2.0:1788909196.391607:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909196.391716:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909196.391809:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004811136 00000100:00100000:0.0:1788909196.391819:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004811136 00000100:00100000:0.0:1788909196.391931:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788909196.391942:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2346:x1875807004811136:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:0.0:1788909196.391972:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d578e 00000100:00080000:0.0:1788909196.391980:0:6676:0:(import.c:65:import_set_state_nolock()) ffff890508528000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788909196.392022:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788909196.392343:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+2:2346:x1875807004811136:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 403us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909196.392353:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:0.0:1788909196.392381:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788909196.392707:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909196.392982:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004811264 00000100:00100000:1.0:1788909196.392988:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004811264 00000100:00100000:1.0:1788909196.393046:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:1.0:1788909196.393055:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004811264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909196.393101:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004811264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909196.393137:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00080000:2.0:1788909196.393280:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909196.423594:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019524096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788909196.423665:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909196.424482:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019524096 00000100:00100000:3.0:1788909196.424497:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019524096 00000100:00100000:3.0:1788909196.424564:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788909196.424574:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019524096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909196.424607:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909196.424657:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019524096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909196.424664:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788909196.424712:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909196.424733:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019524096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788909196.997706:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909197.446262:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905379a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019524224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909197.446368:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909197.446407:0:11699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019524224 00000100:00100000:3.0:1788909197.446419:0:11699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019524224 00000100:00080000:1.0:1788909197.446474:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788909197.446493:0:11699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788909197.446505:0:11699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019524224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788909197.446549:0:11699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909197.446613:0:11699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019524224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909197.446622:0:11699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788909197.446745:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905379a2680 x1875807019524224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909197.446769:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905379a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019524224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909197.450818:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019524608:0@lo:400:kworker.0 00000100:00100000:2.0:1788909197.450911:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909197.450954:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909197.450961:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019524736:0@lo:400:kworker.0 00000100:00100000:2.0:1788909197.450993:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909197.451040:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019524608 00000100:00100000:2.0:1788909197.451048:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019524608 00000100:00100000:2.0:1788909197.451142:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788909197.451152:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019524608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909197.451214:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019524608:12345-0@lo:400:kworker.0 Request processed in 63us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909197.451232:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788909197.451261:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019524736 00000100:00100000:2.0:1788909197.451265:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019524736 00000100:00100000:2.0:1788909197.451293:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788909197.451300:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019524736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909197.451337:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019524736:12345-0@lo:400:kworker.0 Request processed in 37us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909197.451343:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788909197.451388:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019524736:0@lo:400:kworker.0 00000100:00100000:2.0:1788909197.451401:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019524608:0@lo:400:kworker.0 00000100:00080000:2.0:1788909197.451430:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909197.451590:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019524480:0@lo:400:kworker.0 00000100:00100000:1.0:1788909197.451629:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909197.451664:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788909197.451679:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019524352:0@lo:400:kworker.0 00000100:00100000:1.0:1788909197.451711:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909197.451733:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019524864:0@lo:400:kworker.0 00000100:00100000:1.0:1788909197.451755:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909197.451782:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019524480 00000100:00100000:1.0:1788909197.451786:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019524480 00000100:00100000:1.0:1788909197.451810:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019524864 00000100:00100000:1.0:1788909197.451813:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019524864 00000100:00100000:1.0:1788909197.451834:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788909197.451840:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019524480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909197.451878:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019524480:12345-0@lo:400:kworker.0 Request processed in 38us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909197.451884:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788909197.451898:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788909197.451903:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019524864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909197.451928:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019524864:12345-0@lo:400:kworker.0 Request processed in 25us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909197.451933:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788909197.451971:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019524864:0@lo:400:kworker.0 00000100:00100000:1.0:1788909197.451980:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019524480:0@lo:400:kworker.0 00000100:00100000:2.0:1788909197.454038:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019524352 00000100:00100000:2.0:1788909197.454048:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019524352 00000100:00100000:2.0:1788909197.454093:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788909197.454103:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019524352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909197.454199:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019524352:12345-0@lo:400:kworker.0 Request processed in 98us (2486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909197.454206:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:2.0:1788909197.454243:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909197.454375:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019524352:0@lo:400:kworker.0 00000001:00100000:3.0:1788909197.506676:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:3.0:1788909197.506686:0:6701:0:(genops.c:885:class_export_put()) final put ffff89050852d000/9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:2.0:1788909197.512276:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89050852d000/9a693284-9812-4b47-95bb-9bc33a7c4ef4 for lustre-OST0000 00000020:00000080:3.0:1788909197.512551:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff890508528000 for lustre-OST0000 00010000:00010000:2.0:1788909198.022551:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788909198.405835:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788909199.046907:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788909199.135969:0:11848:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:13:17 (1788909197) 00010000:00010000:1.0:1788909200.069656:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909200.331913:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909200.332098:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004811392 00000100:00100000:1.0:1788909200.332144:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004811392 00000100:00100000:1.0:1788909200.332231:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:1.0:1788909200.332243:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:10234:x1875807004811392:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909200.332263:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909200.332323:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5859 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44571 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.332382:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5860 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.332395:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.332408:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909200.332691:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788909200.332696:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909200.332793:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.332818:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5859 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44571 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.332834:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5860 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44571 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.332843:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:1.0:1788909200.332846:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788909200.332849:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692000, rc 0) 00000100:00100000:1.0:1788909200.332904:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:10234:x1875807004811392:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 665us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909200.332912:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00080000:2.0:1788909200.333045:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909200.360665:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909200.360964:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004811520 00000100:00100000:2.0:1788909200.360978:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004811520 00000100:00100000:2.0:1788909200.361057:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1788909200.361067:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:10235:x1875807004811520:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788909200.361087:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909200.361131:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5867 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44578 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.361201:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.361230:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.361243:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.361260:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.361268:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.361274:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363623:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d587c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363654:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d587c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363681:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d587c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909200.363794:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788909200.363799:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909200.363873:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d587c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363885:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363889:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363894:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363898:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909200.363901:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363906:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363915:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:2.0:1788909200.363917:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909200.363920:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363924:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d586e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363940:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363954:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363958:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363966:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909200.363968:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363972:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363977:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff890510293000) 00010000:00010000:2.0:1788909200.363978:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909200.363980:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.363983:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5875 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.364023:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5867 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44578 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.364033:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d587c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44578 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909200.364046:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890510293900) 00010000:00010000:2.0:1788909200.364047:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909200.364049:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10600, rc 0) 00000100:00100000:2.0:1788909200.364167:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:10235:x1875807004811520:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3100us (4339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909200.364175:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788909200.378212:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909200.378554:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004811776 00000100:00100000:1.0:1788909200.378573:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004811776 00000100:00100000:1.0:1788909200.378646:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1788909200.378658:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:10235:x1875807004811776:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909200.378683:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909200.378708:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5883 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4457f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.378788:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.378802:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.378814:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.378871:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.379001:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.379008:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380232:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5898 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380251:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380260:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909200.380282:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788909200.380716:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380727:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380736:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380742:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909200.380747:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380756:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380771:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890510293900) 00010000:00010000:1.0:1788909200.380774:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909200.380780:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380787:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d588a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380801:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380809:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380825:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380831:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909200.380834:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380841:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380849:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff890520ac5800) 00010000:00010000:1.0:1788909200.380851:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909200.380854:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.380860:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5891 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.381829:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5883 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4457f expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.381851:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5898 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4457f expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909200.381860:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:1.0:1788909200.381862:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909200.381865:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693800, rc 0) 00000100:00100000:1.0:1788909200.382029:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:10235:x1875807004811776:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3372us (3826us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788909200.382049:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1788909200.391079:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909200.391218:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004811904 00000100:00100000:2.0:1788909200.391229:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004811904 00000100:00100000:2.0:1788909200.391346:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:2.0:1788909200.391359:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:10235:x1875807004811904:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788909200.391526:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:10235:x1875807004811904:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 160us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909200.391536:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000040:00080000:3.0:1788909200.454159:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788909201.093783:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909201.496769:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909201.496820:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909201.496834:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004812160 00000100:00100000:0.0:1788909201.496847:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004812160 00000100:00100000:0.0:1788909201.496913:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:0.0:1788909201.496925:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2349:x1875807004812160:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909201.496967:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909201.497018:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2349:x1875807004812160:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909201.497020:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004812288 00000100:00100000:1.0:1788909201.497027:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004812288 00000100:00100000:0.0:1788909201.497031:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:1.0:1788909201.497078:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:1.0:1788909201.497088:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004812288:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909201.497156:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004812288:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 71us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909201.497163:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00080000:1.0:1788909201.497185:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909201.497420:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004812032 00000100:00100000:3.0:1788909201.497426:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004812032 00000100:00100000:3.0:1788909201.497504:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:3.0:1788909201.497906:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004812032:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909201.498945:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004812032:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1039us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909201.498964:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 277 00000100:00100000:3.0:1788909201.541949:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019524992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909201.542079:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909201.546441:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019524992 00000100:00100000:2.0:1788909201.546462:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019524992 00000100:00100000:2.0:1788909201.546849:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788909201.546863:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019524992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788909201.546911:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909201.547028:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019524992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (4947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909201.547036:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788909201.547190:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019524992:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788909201.550840:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909201.847422:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909201.849033:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004812416 00000100:00100000:2.0:1788909201.849059:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004812416 00000100:00100000:2.0:1788909201.849158:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1788909201.849171:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:10277:x1875807004812416:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909201.849199:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909201.849224:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d58a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44586 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849303:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849322:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849336:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849351:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849359:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849365:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849694:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849704:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849711:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849723:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909201.849728:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849735:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849748:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:2.0:1788909201.849751:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909201.849756:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849762:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849773:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849778:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849783:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849788:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909201.849791:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849798:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849818:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff890510293000) 00010000:00010000:2.0:1788909201.849821:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909201.849824:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849830:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849868:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d58a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44586 expref: 10 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849880:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:2.0:1788909201.849883:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909201.849887:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d58a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44586 expref: 10 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.849897:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10c00, rc 0) 00000100:00100000:2.0:1788909201.849985:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:10277:x1875807004812416:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 816us (2577us total) trans 0 rc 301/301 00000100:00100000:2.0:1788909201.849994:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1788909201.858164:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909201.858247:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004812672 00000100:00100000:2.0:1788909201.858260:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004812672 00000100:00100000:2.0:1788909201.858329:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1788909201.858342:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:10277:x1875807004812672:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1788909201.858411:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909201.858443:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5860 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44571 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.858490:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:2.0:1788909201.858502:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909201.858816:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.858832:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.858842:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.858855:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.858861:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.858867:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909201.859986:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788909201.860004:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.860012:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.860019:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.860024:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909201.860038:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.860045:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.860061:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:2.0:1788909201.860064:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909201.860069:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.860076:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909201.860097:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5501a4a reply state 0000000052270c9f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909201.860107:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788909201.860280:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:10277:x1875807004812672:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 1935us (2117us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788909201.860292:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00010000:00010000:1.0:1788909201.862550:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.862566:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.862585:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.862592:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909201.862600:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.862608:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.862629:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff890510293f00) 00010000:00010000:1.0:1788909201.862633:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909201.862639:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.862659:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d58c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909201.925041:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909201.925386:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004812800 00000100:00100000:2.0:1788909201.925397:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004812800 00000100:00100000:2.0:1788909201.925451:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1788909201.925462:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:10285:x1875807004812800:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:2.0:1788909201.925485:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909201.925507:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4458d expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.925596:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d58d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.925630:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d58d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.925645:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d58d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909201.925722:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788909201.925726:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909201.925772:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d58d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.925801:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4458d expref: 11 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.925818:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d58d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4458d expref: 10 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.925828:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:2.0:1788909201.925831:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909201.925835:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10c00, rc 0) 00000100:00100000:2.0:1788909201.925904:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:10285:x1875807004812800:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 444us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909201.925911:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:0.0:1788909201.960169:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909201.960312:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004812928 00000100:00100000:2.0:1788909201.960327:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004812928 00000100:00100000:2.0:1788909201.960437:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1788909201.960449:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:10291:x1875807004812928:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909201.960473:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909201.960509:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44594 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.960597:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.960614:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.960628:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.960802:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.960812:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.960819:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.960954:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d58ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961090:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d58ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961100:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d58ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909201.961170:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788909201.961174:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909201.961225:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d58ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961248:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961255:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961263:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961270:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909201.961276:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961285:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961300:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:2.0:1788909201.961303:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909201.961308:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961314:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d58de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961330:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961337:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961343:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961353:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909201.961356:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961363:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961370:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff890510293000) 00010000:00010000:2.0:1788909201.961373:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909201.961376:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961382:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d58e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961420:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d58d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44594 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961436:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d58ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44594 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.961443:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:2.0:1788909201.961446:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788909201.961448:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10e00, rc 0) 00000100:00100000:2.0:1788909201.961546:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:10291:x1875807004812928:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1099us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909201.961556:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1788909201.965394:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909201.967364:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004813184 00000100:00100000:1.0:1788909201.967379:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004813184 00000100:00100000:1.0:1788909201.967449:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1788909201.967471:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:10291:x1875807004813184:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788909201.967492:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909201.967513:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d58f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4459b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.967655:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.967669:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.967680:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.967695:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.967702:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.967708:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788909201.968409:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788909201.968604:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968614:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968621:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968653:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968661:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968667:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968673:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909201.968677:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968685:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968696:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:1.0:1788909201.968699:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909201.968703:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968709:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d58fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788909201.968732:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bf63320 reply state 000000003c1f7c1f transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909201.968741:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788909201.968768:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d58f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4459b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968780:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4459b expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909201.968787:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5b00) 00010000:00010000:1.0:1788909201.968789:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909201.968792:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693600, rc 0) 00000100:00100000:1.0:1788909201.968873:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10291:x1875807004813184:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1414us (3489us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788909201.968881:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00010000:00010000:3.0:1788909201.973785:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.973805:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.973815:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.973833:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909201.973840:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.973848:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.973870:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890520ac5800) 00010000:00010000:3.0:1788909201.973873:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909201.973878:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.973884:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5901 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909201.974272:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909201.974379:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004813312 00000100:00100000:3.0:1788909201.974399:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004813312 00000100:00100000:3.0:1788909201.974446:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788909201.974463:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875807004813312:12345-192.168.204.54@tcp:8:bash.0 00010000:00080000:3.0:1788909201.974506:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:3.0:1788909201.974539:0:6676:0:(genops.c:1385:class_connect()) connect: client 9a693284-9812-4b47-95bb-9bc33a7c4ef4, cookie 0x733cfdd8721d5916 00002000:00100000:3.0:1788909201.974554:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9a693284-9812-4b47-95bb-9bc33a7c4ef4/ffff8905180b2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788909201.975158:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788909201.975471:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788909201.975518:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8905180b6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788909201.975630:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2346:x1875807004813312:12345-192.168.204.54@tcp:8:bash.0 Request processed in 1171us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909201.975641:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788909201.978508:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909201.978609:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004813440 00000100:00100000:2.0:1788909201.978631:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004813440 00000100:00100000:2.0:1788909201.978737:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788909201.978748:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:0:x1875807004813440:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909201.978764:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909201.980125:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445a2 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909201.980155:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909201.980174:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=284s v=(0 0) 00010000:00010000:2.0:1788909201.980178:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909201.980188:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445a2 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.980208:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445a2 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.980222:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10200, rc 0) 00000100:00080000:0.0:1788909201.980281:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909201.980290:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:0:x1875807004813440:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1543us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909201.980299:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788909201.987285:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909201.987425:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004813568 00000100:00100000:2.0:1788909201.987435:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004813568 00000100:00100000:2.0:1788909201.988385:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1788909201.988396:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:10291:x1875807004813568:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909201.988415:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909201.988435:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445a9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.988558:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445a2 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.988576:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909201.988580:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909201.988586:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.988622:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a2 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.988636:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a2 expref: 8 pid: 6675 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909201.988649:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1875807019525120:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909201.988754:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff890533d256c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909201.995323:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909201.995483:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004813696 00000100:00100000:3.0:1788909201.995495:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004813696 00010000:00010000:3.0:1788909201.995542:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a2 expref: 9 pid: 6675 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909201.995617:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1788909201.995628:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2350:x1875807004813696:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909201.995644:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909201.995669:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a2 expref: 9 pid: 6675 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.995685:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a2 expref: 9 pid: 6675 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.995739:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909201.995744:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909201.995753:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.995763:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909201.995810:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909201.995828:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1875807019525248:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788909201.996799:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1a80 going to sleep for 11 seconds 00010000:00010000:2.0:1788909201.997056:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d591d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a2 expref: 9 pid: 6675 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909201.997078:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1875807019525120:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909201.997278:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909201.997295:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11a00, rc 0) 00000100:00100000:2.0:1788909202.000410:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:10291:x1875807004813568:12345-192.168.204.54@tcp:101:bash.0 Request processed in 11998us (13116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.000428:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1788909202.003674:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.004325:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004813952 00000100:00100000:2.0:1788909202.004341:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004813952 00000100:00100000:2.0:1788909202.004439:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788909202.004452:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:10291:x1875807004813952:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1788909202.004562:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1875807019525248:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788909202.004599:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909202.004671:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004813696:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 9045us (9360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909202.004682:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:2.0:1788909202.004872:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10291:x1875807004813952:12345-192.168.204.54@tcp:35:bash.0 Request processed in 423us (1218us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788909202.004879:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00080000:0.0:1788909202.004931:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909202.073637:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909202.076407:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004814208 00000100:00100000:1.0:1788909202.076428:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004814208 00000100:00100000:1.0:1788909202.076603:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1788909202.076615:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10301:x1875807004814208:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788909202.076646:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909202.076670:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d592b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445b0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909202.076802:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788909202.076949:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d592b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445b0 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.076997:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:1.0:1788909202.077001:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788909202.077007:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d592b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445b0 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.077025:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692000, rc 0) 00000100:00100000:1.0:1788909202.077156:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:10301:x1875807004814208:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 488us (3479us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788909202.077165:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1788909202.082482:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.082863:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004814464 00000100:00100000:2.0:1788909202.082883:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004814464 00000100:00100000:2.0:1788909202.082978:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788909202.082992:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:10301:x1875807004814464:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909202.084037:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:10301:x1875807004814464:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 1043us (1575us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788909202.084047:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00010000:00010000:0.0:1788909202.117337:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909202.169832:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.170379:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004814592 00000100:00100000:2.0:1788909202.170393:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004814592 00000100:00100000:2.0:1788909202.170487:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1788909202.170501:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:10307:x1875807004814592:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909202.170540:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909202.170584:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445b7 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.170673:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.170707:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.170718:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909202.170785:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788909202.170790:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909202.170817:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.170844:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445b7 expref: 18 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.170864:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445b7 expref: 17 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.170873:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:2.0:1788909202.170876:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909202.170880:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11c00, rc 0) 00000100:00100000:2.0:1788909202.171036:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:10307:x1875807004814592:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 537us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.171043:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:0.0:1788909202.175781:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.175904:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004814848 00000100:00100000:2.0:1788909202.175917:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004814848 00000100:00100000:2.0:1788909202.175996:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1788909202.176008:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:10307:x1875807004814848:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909202.176039:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909202.176084:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5947 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445be expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.176218:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d594e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.176239:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d594e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.176252:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d594e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909202.176264:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788909202.176719:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5947 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445be expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.176741:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d594e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445be expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.176751:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5b00) 00010000:00010000:2.0:1788909202.176754:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909202.176758:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10a00, rc 0) 00000100:00100000:2.0:1788909202.176989:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10307:x1875807004814848:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 982us (1218us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788909202.176997:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1788909202.182260:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909202.182860:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.183001:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004815104 00000100:00100000:1.0:1788909202.183002:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004815232 00000100:00100000:1.0:1788909202.183017:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004815232 00000100:00100000:2.0:1788909202.183018:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004815104 00000100:00100000:2.0:1788909202.183131:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788909202.183145:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:10307:x1875807004815104:12345-192.168.204.54@tcp:101:lfs.0 00000100:00100000:1.0:1788909202.183172:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1788909202.183181:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:2348:x1875807004815232:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909202.183190:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909202.183195:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909202.183214:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d595c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445c5 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.183223:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d594e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445be expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.183240:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5b00) 00010000:00010000:1.0:1788909202.183245:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909202.183327:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:2348:x1875807004815232:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 144us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909202.183336:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00010000:00010000:2.0:1788909202.183350:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5963 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.183368:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.183380:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909202.183394:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788909202.183536:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d595c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445c5 expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.183554:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5963 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445c5 expref: 20 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.183581:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5b00) 00010000:00010000:2.0:1788909202.183584:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788909202.183587:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909202.183628:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:10307:x1875807004815104:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 486us (1379us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788909202.183635:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1788909202.193584:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.193717:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004815360 00000100:00100000:2.0:1788909202.193738:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004815360 00000100:00100000:2.0:1788909202.193887:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1788909202.193933:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004815360:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:2.0:1788909202.193990:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.194015:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.194023:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909202.194028:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788909202.194032:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.194076:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.194092:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 7 pid: 6673 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909202.194152:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6675:1875807019525376:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909202.194285:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909202.196296:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6675:1875807019525376:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909202.196340:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909202.197923:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909202.198717:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004815488 00000100:00100000:3.0:1788909202.198729:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004815488 00002000:00100000:3.0:1788909202.198785:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff89050937b800 x1875807004815488/t0(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:133/0 lens 504/0 e 0 to 0 dl 1788909213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788909202.198814:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89050937b800 with x1875807004815488 ext(0->12) 00010000:00010000:3.0:1788909202.198825:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 8 pid: 6673 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909202.198843:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 8 pid: 6673 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909202.198853:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89050937b800 00000100:00100000:3.0:1788909202.199652:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788909202.199670:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2349:x1875807004815488:12345-192.168.204.54@tcp:4:lfs.0 00000001:00100000:1.0:1788909202.233536:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000100:00100000:0.0:1788909202.234582:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2349:x1875807004815488:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 34901us (36657us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788909202.234600:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:0.0:1788909202.234613:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff89050937b800 x1875807004815488/t4294967299(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:133/0 lens 504/448 e 0 to 0 dl 1788909213 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788909202.234624:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89050937b800 with x1875807004815488 ext(0->12) 00010000:00010000:0.0:1788909202.234634:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 9 pid: 6673 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.234655:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 9 pid: 6673 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788909202.234663:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89050937b800 00000100:00100000:2.0:1788909202.240406:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909202.240516:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004815616 00000100:00100000:0.0:1788909202.240528:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004815616 00010000:00010000:0.0:1788909202.240581:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 9 pid: 6673 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909202.240667:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1788909202.240679:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2350:x1875807004815616:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909202.240696:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788909202.240722:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788909202.240726:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788909201 00002000:00010000:0.0:1788909202.240729:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788909201 00002000:00010000:0.0:1788909202.240731:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788909201 00010000:00010000:0.0:1788909202.240738:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 9 pid: 6673 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.240772:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 9 pid: 6673 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.240799:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d5924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a445a9 expref: 9 pid: 6673 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.240818:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909202.240823:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909202.240830:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.240840:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.240877:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909202.240986:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004815616:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 308us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909202.240994:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00010000:00010000:2.0:1788909202.241083:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.241101:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.241153:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.241163:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.241171:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.241178:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909202.241183:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.241191:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.241204:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.241212:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d5971 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909202.241276:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004815360:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 47348us (47727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.241285:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1788909202.244890:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909202.244998:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004815872 00000100:00100000:0.0:1788909202.245011:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004815872 00000100:00100000:0.0:1788909202.245093:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788909202.245104:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:10307:x1875807004815872:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:0.0:1788909202.246435:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5963 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445c5 expref: 20 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788909202.246827:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788909202.246887:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788909202.247554:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788909202.247645:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.247667:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4459b expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.247677:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.247728:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4459b expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.247747:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4459b expref: 24 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909202.247764:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890509378a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875807019525504:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909202.247887:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905274afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788909202.252199:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.252309:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004816000 00000100:00100000:2.0:1788909202.252321:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004816000 00010000:00010000:2.0:1788909202.252365:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4459b expref: 25 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909202.252408:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1788909202.252419:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+25:2350:x1875807004816000:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909202.252439:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909202.252448:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4459b expref: 25 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909202.252466:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890509378a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875807019525504:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909202.252467:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4459b expref: 25 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.252501:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5908 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4459b expref: 25 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.252506:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.252527:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5b00) 00010000:00010000:2.0:1788909202.252534:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.252544:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.252572:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.252604:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909202.252876:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.252886:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909202.252942:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:2350:x1875807004816000:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 523us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.252952:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000001:00080000:0.0:1788909202.253062:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788909202.253384:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788909202.253533:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890509378a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875807019525632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788909202.253596:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909202.253634:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905274af240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909202.253651:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019525632 00000100:00100000:3.0:1788909202.253657:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019525632 00000100:00100000:3.0:1788909202.253715:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788909202.253724:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875807019525632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788909202.253837:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875807019525632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 113us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909202.253843:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788909202.254174:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909202.254373:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890509378a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875807019525632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788909202.256133:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788909202.256249:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e55c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875807019525760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788909202.256321:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909202.256360:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff890513426a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909202.256536:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019525760 00000100:00100000:3.0:1788909202.256543:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019525760 00000100:00100000:3.0:1788909202.256596:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788909202.256604:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875807019525760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788909202.256782:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5826:x1875807019525760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (461us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788909202.256789:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788909202.257364:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e55c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875807019525760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788909202.257425:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788909202.257468:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.257478:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.257485:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.257490:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ca00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909202.257494:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.257501:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.257523:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5b00) 00010000:00010000:2.0:1788909202.257526:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788909202.257530:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.257535:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5978 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788909202.257704:0:5826:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788909202.257924:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788909202.257938:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284331827157ns, next at 285331824576ns, rc = 0 00000001:00080000:2.0:1788909202.257944:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788909202.257983:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5b00) 00010000:00010000:2.0:1788909202.257986:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788909202.257994:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5963 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445c5 expref: 28 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909202.258159:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:10307:x1875807004815872:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 13055us (13281us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788909202.258168:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000020:00080000:2.0:1788909202.260023:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788909202.263631:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909202.263749:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004816128 00000100:00100000:0.0:1788909202.263759:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004816128 00000100:00100000:0.0:1788909202.263864:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:0.0:1788909202.263875:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:10307:x1875807004816128:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909202.263916:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909202.263946:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d597f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445cc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.264030:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d597f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445cc expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.264046:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d597f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445cc expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.264066:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909202.264069:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909202.264074:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d600, rc 0) 00000100:00100000:0.0:1788909202.264364:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:10307:x1875807004816128:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 489us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909202.264372:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:0.0:1788909202.268362:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.268435:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004816384 00000100:00100000:2.0:1788909202.268446:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004816384 00000100:00100000:2.0:1788909202.268517:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788909202.268529:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051723bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:10307:x1875807004816384:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909202.268836:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051723bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10307:x1875807004816384:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 308us (482us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788909202.268855:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788909202.347077:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909202.347217:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004816640 00000100:00100000:3.0:1788909202.347229:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004816640 00000100:00100000:2.0:1788909202.347390:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:2.0:1788909202.347406:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10317:x1875807004816640:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909202.347437:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909202.347459:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445d3 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909202.347601:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788909202.347749:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5986 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445d3 expref: 31 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.347765:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:2.0:1788909202.347768:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909202.347775:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445d3 expref: 31 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.347791:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909202.347871:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10317:x1875807004816640:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 469us (802us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788909202.347880:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788909202.351425:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.351780:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004816768 00000100:00100000:2.0:1788909202.351799:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004816768 00000100:00100000:2.0:1788909202.351894:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1788909202.351914:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10317:x1875807004816768:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788909202.351993:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352027:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352041:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352057:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352064:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352070:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352198:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352206:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352214:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909202.352264:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352280:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352287:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352319:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352325:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909202.352330:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352338:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352355:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:2.0:1788909202.352359:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909202.352364:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352371:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5994 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352387:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352394:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352399:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352405:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909202.352408:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352423:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352432:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890510293000) 00010000:00010000:2.0:1788909202.352434:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909202.352437:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352444:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d599b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352461:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352467:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352473:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352478:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909202.352480:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352486:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352493:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909202.352496:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909202.352499:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.352514:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909202.352636:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10317:x1875807004816768:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 731us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.352646:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1788909202.358623:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.358817:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004817024 00000100:00100000:2.0:1788909202.358832:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004817024 00000100:00100000:2.0:1788909202.358918:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1788909202.358932:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10317:x1875807004817024:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909202.359594:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10317:x1875807004817024:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 663us (987us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788909202.359604:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788909202.401702:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909202.401985:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004817280 00000100:00100000:1.0:1788909202.402001:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004817280 00000100:00100000:1.0:1788909202.402200:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1788909202.402214:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10320:x1875807004817280:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788909202.402665:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909202.402699:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d59a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445da expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.402856:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.402875:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.402889:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.402907:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.403199:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.403211:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.403835:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.403867:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.403876:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909202.403889:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788909202.404025:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404033:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404041:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404047:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909202.404052:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404060:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404179:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:1.0:1788909202.404183:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909202.404189:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404196:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d59b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404215:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404229:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404235:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404241:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909202.404244:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404251:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404686:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890520ac5800) 00010000:00010000:1.0:1788909202.404690:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909202.404693:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404699:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d59b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404779:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d59a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445da expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404796:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445da expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.404806:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:1.0:1788909202.404808:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909202.404819:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501692c00, rc 0) 00000100:00100000:1.0:1788909202.406220:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10320:x1875807004817280:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3991us (4516us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788909202.406237:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1788909202.411686:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.415557:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004817408 00000100:00100000:2.0:1788909202.415593:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004817408 00000100:00100000:2.0:1788909202.415770:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1788909202.415784:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10320:x1875807004817408:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788909202.415899:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.415927:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.415944:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.415989:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.416020:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.416029:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.416037:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909202.416044:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.416052:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.416069:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909202.416072:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909202.416078:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.416084:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909202.416277:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10320:x1875807004817408:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 495us (4605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.416286:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1788909202.420031:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.424182:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004817664 00000100:00100000:2.0:1788909202.424208:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004817664 00000100:00100000:2.0:1788909202.424478:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1788909202.424497:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10320:x1875807004817664:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909202.424910:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:10320:x1875807004817664:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 417us (4899us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788909202.428677:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1788909202.565840:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905379a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019525888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909202.565948:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909202.566070:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019525888 00000100:00100000:2.0:1788909202.566080:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019525888 00000100:00100000:2.0:1788909202.566161:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788909202.566172:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875807019525888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788909202.566203:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909202.566253:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875807019525888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.566260:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788909202.566446:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019526272:0@lo:400:kworker.0 00000100:00100000:3.0:1788909202.566518:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909202.566578:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019526144:0@lo:400:kworker.0 00000100:00100000:3.0:1788909202.566599:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019526016:0@lo:400:kworker.0 00000100:00100000:0.0:1788909202.566637:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909202.566650:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909202.566700:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019526528:0@lo:400:kworker.0 00000100:00100000:3.0:1788909202.567068:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909202.567099:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788909202.567140:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019526400:0@lo:400:kworker.0 00000100:00100000:3.0:1788909202.567174:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909202.567188:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905379a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019525888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909202.567221:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019526400 00000100:00100000:0.0:1788909202.567231:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019526272 00000100:00100000:3.0:1788909202.567232:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019526400 00000100:00100000:0.0:1788909202.567240:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019526272 00000100:00100000:3.0:1788909202.567305:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788909202.567317:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019526400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909202.567368:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019526400:12345-0@lo:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909202.567374:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788909202.567416:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019526400:0@lo:400:kworker.0 00000100:00100000:3.0:1788909202.567470:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019526016 00000100:00100000:3.0:1788909202.567475:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019526016 00000100:00100000:3.0:1788909202.567513:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788909202.567522:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019526016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909202.567585:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019526016:12345-0@lo:400:kworker.0 Request processed in 64us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909202.567611:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788909202.567680:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019526016:0@lo:400:kworker.0 00000100:00080000:2.0:1788909202.568164:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909202.568179:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019526144 00000100:00100000:2.0:1788909202.568186:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019526144 00000100:00100000:2.0:1788909202.568208:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019526528 00000100:00100000:2.0:1788909202.568211:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019526528 00000100:00080000:2.0:1788909202.568228:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909202.568246:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788909202.568256:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019526272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909202.568367:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019526272:12345-0@lo:400:kworker.0 Request processed in 112us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.568374:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788909202.568425:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019526272:0@lo:400:kworker.0 00000100:00100000:2.0:1788909202.568451:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788909202.568459:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019526144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909202.568509:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019526144:12345-0@lo:400:kworker.0 Request processed in 51us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.568515:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788909202.568528:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788909202.568533:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019526528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909202.568580:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019526528:12345-0@lo:400:kworker.0 Request processed in 46us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.568585:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788909202.568611:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019526528:0@lo:400:kworker.0 00000100:00100000:2.0:1788909202.568655:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019526144:0@lo:400:kworker.0 00000001:00080000:3.0:1788909202.614827:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000001:00080000:3.0:1788909202.614861:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967329 is committed 00000001:00080000:3.0:1788909202.614878:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:3.0:1788909202.614894:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788909202.614940:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89053c53d780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788909202.614945:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890537acb800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89053c53dcc0 00000020:00080000:3.0:1788909202.614948:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890537acbc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890508ff0000 00000020:00080000:2.0:1788909202.615189:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788909202.615322:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788909202.615691:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788909202.615717:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905379a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019526656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788909202.615783:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909202.615838:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019526656 00000100:00100000:1.0:1788909202.615844:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019526656 00000100:00100000:1.0:1788909202.616169:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788909202.616181:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1875807019526656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788909202.616210:0:8092:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788909202.616311:0:8092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa09691, atime: 0x6aa09691, ctime: 0x6aa09691, blocks: 0x1 00010000:00010000:1.0:1788909202.616322:0:8092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.616343:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1788909202.616348:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909202.616356:0:8092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.616373:0:8092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.616384:0:8092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.616414:0:8092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.616432:0:8092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788909202.617749:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3284:x1875807019526656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1566us (1960us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788909202.617761:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788909202.617789:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:0.0:1788909202.617793:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8905379a2a00/2, rc 0, transno 4294967301 00010000:00010000:1.0:1788909202.617796:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909202.617800:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905379a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019526656:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788909202.617806:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909202.617811:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.617821:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.617840:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.617848:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005eac72c9/0x733cfdd8721d59d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909202.617869:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909202.617988:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909202.617990:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909202.730270:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.730543:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004817920 00000100:00100000:2.0:1788909202.730569:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004817920 00000100:00100000:2.0:1788909202.730630:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1788909202.730641:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:10351:x1875807004817920:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788909202.730669:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909202.730691:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445e1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.730829:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d59e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.730851:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d59e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.730864:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d59e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909202.730886:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788909202.731167:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d59da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445e1 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.731188:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d59e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445e1 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.731197:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909202.731200:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909202.731203:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11200, rc 0) 00000100:00100000:2.0:1788909202.731300:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10351:x1875807004817920:12345-192.168.204.54@tcp:101:cat.0 Request processed in 660us (1043us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788909202.731307:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1788909202.736762:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909202.736817:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909202.736944:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004818048 00000100:00100000:3.0:1788909202.736954:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004818048 00000100:00100000:3.0:1788909202.737052:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788909202.737064:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2347:x1875807004818048:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909202.737082:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909202.737142:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d59e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445e1 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909202.737165:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909202.737170:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909202.737239:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:2347:x1875807004818048:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 177us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909202.737259:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788909202.740476:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004818304 00000100:00100000:0.0:1788909202.740493:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004818304 00000100:00100000:0.0:1788909202.740580:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788909202.740592:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:10351:x1875807004818304:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:0.0:1788909202.741520:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10351:x1875807004818304:12345-192.168.204.54@tcp:35:cat.0 Request processed in 923us (4694us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788909202.741533:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1788909202.819979:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909202.820191:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004818560 00000100:00100000:0.0:1788909202.820202:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004818560 00000100:00100000:0.0:1788909202.820271:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:0.0:1788909202.820280:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10357:x1875807004818560:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:0.0:1788909202.820304:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909202.820306:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788909202.820344:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445b7 expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.820501:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909202.820506:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909202.820521:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d59ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.820624:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.820650:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445da expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.820659:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.820690:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445da expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.820704:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445da expref: 14 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909202.820716:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89050937ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019526784:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909202.820809:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905274af600 going to sleep for 11 seconds 00000100:00100000:1.0:1788909202.826959:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.827050:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004818688 00000100:00100000:2.0:1788909202.827060:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004818688 00010000:00010000:2.0:1788909202.827135:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445da expref: 15 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909202.827186:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1788909202.827198:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:2350:x1875807004818688:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909202.827213:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909202.827220:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445da expref: 15 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.827234:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445da expref: 15 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.827279:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909202.827285:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.827294:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.827302:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.827323:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909202.827401:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:2350:x1875807004818688:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 205us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909202.827409:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00010000:00010000:0.0:1788909202.828407:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d59be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445da expref: 14 pid: 5824 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909202.828433:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89050937ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019526784:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909202.828484:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.828493:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.828499:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909202.828521:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788909202.829091:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d59ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445e8 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.829141:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445e8 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.829152:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909202.829155:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788909202.829159:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ca00, rc 0) 00000100:00100000:0.0:1788909202.829221:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10357:x1875807004818560:12345-192.168.204.54@tcp:101:dd.0 Request processed in 8941us (9252us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788909202.829229:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1788909202.837278:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909202.837590:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004818944 00000100:00100000:2.0:1788909202.837603:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004818944 00000100:00100000:2.0:1788909202.837752:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1788909202.837763:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10357:x1875807004818944:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:2.0:1788909202.838817:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.838843:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909202.838855:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788909202.839030:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788909202.839058:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000856bcc83 reply state 0000000052d7423f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909202.839169:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788909202.839563:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:10357:x1875807004818944:12345-192.168.204.54@tcp:36:dd.0 Request processed in 1786us (2280us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788909202.839573:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000020:00080000:2.0:1788909202.839579:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788909202.842704:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.842725:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.842733:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.842761:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909202.842766:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.842774:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.842794:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909202.842797:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909202.842802:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909202.842808:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5a04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909203.099698:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909203.101667:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004819072 00000100:00100000:3.0:1788909203.101682:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004819072 00000100:00100000:3.0:1788909203.101772:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1788909203.101804:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:10371:x1875807004819072:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:3.0:1788909203.101836:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909203.101857:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445ef expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.102299:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.102320:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.102336:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.102354:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.102361:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.102368:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.102851:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.102867:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445e8 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.102877:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.103375:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445e8 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.103399:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445e8 expref: 17 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909203.103419:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019526912:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909203.103658:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788909203.109262:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909203.109329:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004819328 00000100:00100000:2.0:1788909203.109341:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004819328 00000100:00100000:2.0:1788909203.109401:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788909203.109412:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:6050:x1875807004819328:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788909203.109419:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019526912:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909203.109444:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909203.110517:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:6050:x1875807004819328:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 1097us (1255us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788909203.110529:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788909203.114988:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909203.119219:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004819456 00000100:00100000:3.0:1788909203.119238:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004819456 00010000:00010000:3.0:1788909203.119852:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445e8 expref: 19 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909203.119907:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1788909203.119919:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:2349:x1875807004819456:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909203.119934:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909203.119942:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445e8 expref: 19 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.119955:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445e8 expref: 19 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.119998:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d59f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445e8 expref: 19 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.120018:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909203.120024:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.120033:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.120041:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.122172:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909203.122300:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:2349:x1875807004819456:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 2375us (7315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909203.122315:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00010000:00010000:1.0:1788909203.124423:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909203.124442:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909203.124619:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788909203.124625:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909203.124680:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124695:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124704:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124711:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124718:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124741:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.124745:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124752:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124768:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909203.124771:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.124776:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124781:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124798:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124804:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124810:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124814:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.124817:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124823:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124841:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890507e13d00) 00010000:00010000:0.0:1788909203.124844:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.124847:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124854:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124900:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445ef expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124914:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445ef expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.124921:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909203.124924:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909203.124926:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9200, rc 0) 00000100:00100000:0.0:1788909203.125007:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:10371:x1875807004819072:12345-192.168.204.54@tcp:101:stat.0 Request processed in 23206us (25324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909203.125016:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00010000:00010000:0.0:1788909203.144365:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909203.196976:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909203.197555:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004819712 00000100:00100000:0.0:1788909203.197570:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004819712 00000100:00100000:0.0:1788909203.197696:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:0.0:1788909203.197710:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:10377:x1875807004819712:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:0.0:1788909203.197775:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909203.197806:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445ef expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.197843:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909203.197849:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909203.198151:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.198167:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.198179:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788909203.198237:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788909203.198277:0:7640:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c4ebb17 reply state 00000000e2bef9af transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909203.198287:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788909203.198421:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10377:x1875807004819712:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 713us (1461us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788909203.198430:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000020:00080000:0.0:1788909203.198437:0:7640:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788909203.201847:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.201867:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.201876:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.201882:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9da00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909203.201888:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.201919:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.201942:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909203.201946:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909203.201952:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.201959:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909203.314034:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909203.314180:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004819840 00000100:00100000:0.0:1788909203.314202:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004819840 00000100:00100000:0.0:1788909203.314299:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1788909203.314311:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:10391:x1875807004819840:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:0.0:1788909203.314340:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909203.314368:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.314476:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.314493:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.314508:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.314527:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.314534:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.314554:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.314970:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.314981:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.314988:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909203.315039:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788909203.315046:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909203.315073:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315095:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315102:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315154:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315160:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315166:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.315170:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315178:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315190:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909203.315193:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.315198:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315204:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315216:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315221:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315233:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315238:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9da00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.315240:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315246:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315254:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890513293400) 00010000:00010000:0.0:1788909203.315256:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.315258:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315263:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315299:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445f6 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315312:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445f6 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.315319:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909203.315321:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909203.315323:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ca00, rc 0) 00000100:00100000:0.0:1788909203.315398:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10391:x1875807004819840:12345-192.168.204.54@tcp:101:stat.0 Request processed in 1089us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909203.315417:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:1.0:1788909203.382960:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909203.384689:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004820096 00000100:00100000:2.0:1788909203.384710:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004820096 00000100:00100000:2.0:1788909203.384907:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1788909203.384922:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10401:x1875807004820096:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909203.384956:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909203.384990:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5a4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a445fd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909203.385410:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1788909203.385934:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5a4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445fd expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.385960:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:2.0:1788909203.385963:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909203.385979:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5a4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445fd expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.386000:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10200, rc 0) 00000100:00100000:2.0:1788909203.386094:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:10401:x1875807004820096:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1175us (3221us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788909203.386104:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1788909203.391835:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909203.392883:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004820352 00000100:00100000:0.0:1788909203.392900:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004820352 00000100:00100000:0.0:1788909203.392989:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1788909203.393002:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:10401:x1875807004820352:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788909203.396149:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10401:x1875807004820352:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 3110us (4291us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788909203.396167:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788909203.457823:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909203.458150:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004820608 00000100:00100000:3.0:1788909203.458168:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004820608 00000100:00100000:3.0:1788909203.458346:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788909203.458362:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10407:x1875807004820608:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788909203.458404:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909203.458439:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44604 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.458633:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.458654:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445f6 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.458665:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.458718:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445f6 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.458759:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445f6 expref: 22 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909203.458777:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019527040:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909203.459017:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909203.464349:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019527040:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909203.464398:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909203.464639:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909203.465751:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004820736 00000100:00100000:3.0:1788909203.465766:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004820736 00010000:00010000:3.0:1788909203.465886:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445f6 expref: 23 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909203.466010:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788909203.466022:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:2349:x1875807004820736:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909203.466044:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909203.466054:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445f6 expref: 23 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.466071:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445f6 expref: 23 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.466103:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5a43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a445f6 expref: 23 pid: 5822 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.466196:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909203.466203:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.466213:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.466222:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.466271:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909203.466381:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:2349:x1875807004820736:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 360us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909203.466391:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00010000:00010000:0.0:1788909203.466474:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.466483:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909203.466517:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788909203.468814:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44604 expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.468865:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44604 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.468876:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909203.468879:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788909203.468882:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9e00, rc 0) 00000100:00100000:0.0:1788909203.468984:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:10407:x1875807004820608:12345-192.168.204.54@tcp:101:bash.0 Request processed in 10626us (11181us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788909203.468995:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:1.0:1788909203.471996:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909203.472883:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004820992 00000100:00100000:0.0:1788909203.472902:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004820992 00000100:00100000:0.0:1788909203.473009:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1788909203.473023:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:10407:x1875807004820992:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:0.0:1788909203.475677:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.476103:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.476142:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788909203.476302:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788909203.477157:0:7640:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001589bdaa reply state 00000000c3738a27 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909203.477175:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788909203.478175:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+25:10407:x1875807004820992:12345-192.168.204.54@tcp:36:bash.0 Request processed in 5139us (6184us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788909203.478190:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000020:00080000:0.0:1788909203.478199:0:7640:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788909203.487460:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.487488:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.487497:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.487503:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ce00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.487557:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.487565:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.487588:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909203.487591:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.487598:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.487605:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909203.490785:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909203.491022:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004821120 00000100:00100000:0.0:1788909203.491044:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004821120 00000100:00100000:3.0:1788909203.491201:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1788909203.491230:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:10407:x1875807004821120:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788909203.491283:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909203.491321:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4460b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.491617:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.491638:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44604 expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.491649:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.491726:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44604 expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.491745:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44604 expref: 25 pid: 5824 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909203.491764:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019527168:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909203.491901:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788909203.496260:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909203.496873:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cc38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019527168:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909203.497788:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909203.497856:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004821248 00000100:00100000:2.0:1788909203.497869:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004821248 00010000:00010000:2.0:1788909203.498014:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44604 expref: 26 pid: 5824 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909203.498067:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1788909203.498082:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:2350:x1875807004821248:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909203.498104:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909203.498137:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44604 expref: 26 pid: 5824 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.498153:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44604 expref: 26 pid: 5824 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.498186:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5a5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44604 expref: 26 pid: 5824 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.498208:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909203.498213:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.498721:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.498731:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.498769:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909203.498870:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+25:2350:x1875807004821248:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 789us (2638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909203.498880:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00010000:00010000:3.0:1788909203.499007:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.499017:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909203.499088:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788909203.499094:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788909203.499148:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.499191:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4460b expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.499212:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4460b expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.499669:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909203.499673:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788909203.499678:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9600, rc 0) 00000100:00100000:3.0:1788909203.499738:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:10407:x1875807004821120:12345-192.168.204.54@tcp:101:bash.0 Request processed in 8521us (8969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909203.499747:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:1.0:1788909203.505898:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909203.506329:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004821504 00000100:00100000:2.0:1788909203.506345:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004821504 00000100:00100000:2.0:1788909203.506426:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788909203.506440:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:10407:x1875807004821504:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1788909203.507040:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+25:10407:x1875807004821504:12345-192.168.204.54@tcp:35:bash.0 Request processed in 599us (1153us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788909203.507050:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1788909203.598011:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909203.600475:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004821760 00000100:00100000:2.0:1788909203.600501:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004821760 00000100:00100000:2.0:1788909203.600633:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1788909203.600646:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+25:10417:x1875807004821760:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909203.600685:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909203.600715:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5a82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44612 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909203.601101:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1788909203.601562:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5a82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44612 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.601593:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:2.0:1788909203.601597:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909203.601605:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5a82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44612 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.601626:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909203.601725:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:10417:x1875807004821760:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1080us (3731us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788909203.601737:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:1.0:1788909203.609349:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909203.609433:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004821888 00000100:00100000:0.0:1788909203.609447:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004821888 00000100:00100000:0.0:1788909203.609531:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1788909203.609555:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:10417:x1875807004821888:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1788909203.609669:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.609692:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.609708:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.609727:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.609757:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.609764:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610205:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610216:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610224:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788909203.610299:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610316:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610324:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610333:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610340:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ce00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.610345:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610354:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610379:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909203.610382:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.610388:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610395:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610411:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610417:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610428:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610434:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9da00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.610436:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610442:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610449:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890513293400) 00010000:00010000:0.0:1788909203.610451:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.610454:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610459:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610486:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610492:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610498:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610503:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.610506:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610512:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610521:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909203.610523:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.610526:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.610532:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909203.610658:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:10417:x1875807004821888:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1104us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909203.610668:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1788909203.613818:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909203.614529:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004822144 00000100:00100000:0.0:1788909203.614556:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004822144 00000100:00100000:0.0:1788909203.614645:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:0.0:1788909203.614680:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:10417:x1875807004822144:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788909203.615482:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:10417:x1875807004822144:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 802us (1678us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788909203.615495:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1788909203.649718:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909203.650047:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004822400 00000100:00100000:2.0:1788909203.650065:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004822400 00000100:00100000:0.0:1788909203.650913:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1788909203.650933:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:10420:x1875807004822400:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909203.650972:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909203.651003:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5aa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44619 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.651148:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.651168:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.651183:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.651203:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.651210:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.651218:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652317:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5aba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652345:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652355:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909203.652370:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788909203.652501:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652509:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652516:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652522:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9da00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.652527:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652547:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652563:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909203.652566:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.652571:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652578:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652594:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652606:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652612:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652618:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ce00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.652621:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652628:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652636:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890513293400) 00010000:00010000:0.0:1788909203.652639:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.652641:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652648:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652725:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5aa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44619 expref: 30 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.652740:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44619 expref: 29 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.656123:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909203.656130:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909203.656163:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d400, rc 0) 00000100:00100000:0.0:1788909203.656366:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10420:x1875807004822400:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 5433us (6673us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788909203.656381:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:1.0:1788909203.661488:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909203.661598:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909203.661705:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004822528 00000100:00100000:3.0:1788909203.661724:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004822528 00000100:00100000:3.0:1788909203.661801:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1788909203.661812:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10420:x1875807004822528:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788909203.661915:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.661935:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.661950:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.661989:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.661998:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.662006:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.662012:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909203.662037:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.662047:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.662063:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909203.662066:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788909203.662071:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.662078:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909203.662262:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10420:x1875807004822528:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 451us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909203.662271:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1788909203.663928:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004822656 00000100:00100000:2.0:1788909203.663943:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004822656 00000100:00100000:2.0:1788909203.664036:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788909203.664048:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:2349:x1875807004822656:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909203.664068:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909203.664098:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5aba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44619 expref: 29 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909203.664144:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909203.664158:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909203.664227:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:2349:x1875807004822656:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 181us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909203.664235:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1788909203.669307:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909203.669568:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004822912 00000100:00100000:2.0:1788909203.669607:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004822912 00000100:00100000:2.0:1788909203.669696:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788909203.669708:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:10420:x1875807004822912:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909203.670054:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10420:x1875807004822912:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 347us (763us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788909203.670064:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:1.0:1788909203.791584:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909203.791720:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004823168 00000100:00100000:3.0:1788909203.791731:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004823168 00000100:00100000:3.0:1788909203.791870:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788909203.791896:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10438:x1875807004823168:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1788909203.791932:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909203.791955:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5acf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44620 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.792062:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ad6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.792076:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.792104:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909203.792414:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788909203.792559:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5acf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44620 expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.792579:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44620 expref: 31 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.792589:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909203.792592:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788909203.792595:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9200, rc 0) 00000100:00100000:3.0:1788909203.792704:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10438:x1875807004823168:12345-192.168.204.54@tcp:101:cat.0 Request processed in 822us (1129us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788909203.792712:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1788909203.826737:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909203.826898:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004823296 00000100:00100000:3.0:1788909203.827017:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004823296 00000100:00100000:3.0:1788909203.827380:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:3.0:1788909203.827393:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10439:x1875807004823296:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909203.827434:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909203.827464:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44627 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.827585:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5aeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.827631:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.827648:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909203.827935:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1788909203.827940:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788909203.828029:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.828064:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44627 expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.828088:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5aeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44627 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.828101:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:3.0:1788909203.828104:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788909203.828181:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9e00, rc 0) 00000100:00100000:3.0:1788909203.828294:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10439:x1875807004823296:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 903us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909203.828303:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788909203.833020:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909203.834471:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004823680 00000100:00100000:2.0:1788909203.834495:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004823680 00000100:00100000:2.0:1788909203.834692:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788909203.834710:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10439:x1875807004823680:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909203.835305:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10439:x1875807004823680:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 596us (2299us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788909203.835317:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788909203.843886:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909203.843968:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004823808 00000100:00100000:3.0:1788909203.843983:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004823808 00000100:00100000:3.0:1788909203.844255:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788909203.844396:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10439:x1875807004823808:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:3.0:1788909203.844434:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788909203.844510:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5a7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4460b expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.844564:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ad6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44620 expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.844581:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d597f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a445cc expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909203.844595:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909203.844611:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909203.844718:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10439:x1875807004823808:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 450us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909203.844727:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788909203.851387:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909203.856358:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004823936 00000100:00100000:0.0:1788909203.856382:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004823936 00000100:00100000:0.0:1788909203.856463:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:0.0:1788909203.856473:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10439:x1875807004823936:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:0.0:1788909203.856641:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.856734:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.856750:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788909203.857989:0:7640:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788909203.858733:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788909203.858801:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788909203.858945:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10439:x1875807004823936:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 2466us (7559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909203.858960:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1788909203.888764:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909203.888857:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004824064 00000100:00100000:0.0:1788909203.888868:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004824064 00000100:00100000:0.0:1788909203.888941:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:0.0:1788909203.888951:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10441:x1875807004824064:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909203.888973:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909203.888993:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5af9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4462e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889086:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889102:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889139:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889155:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889162:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889169:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889459:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889468:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889475:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909203.889510:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788909203.889514:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909203.889547:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889570:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889579:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889585:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889591:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889597:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9da00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.889601:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889608:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889620:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909203.889623:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.889628:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889633:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889645:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889650:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889662:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889666:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909203.889669:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889675:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889682:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890513293500) 00010000:00010000:0.0:1788909203.889685:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909203.889687:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889692:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889724:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5af9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4462e expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889738:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4462e expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909203.889745:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293400) 00010000:00010000:0.0:1788909203.889747:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788909203.889750:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d600, rc 0) 00000100:00100000:0.0:1788909203.889808:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10441:x1875807004824064:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 859us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909203.889823:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00010000:00010000:1.0:1788909204.165627:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788909204.549899:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788909204.549909:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788909204.549962:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788909204.549970:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788909204.550321:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890508ff8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019527296:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788909204.550494:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788909204.560794:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890508ff8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019527296:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788909204.563810:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909204.564161:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004824192 00000100:00100000:3.0:1788909204.564176:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004824192 00000100:00100000:3.0:1788909204.564245:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788909204.564257:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10453:x1875807004824192:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788909204.564372:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10453:x1875807004824192:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 118us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909204.564381:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00080000:3.0:1788909204.564411:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788909204.565099:0:12000:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788909204.565107:0:12000:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788909204.565253:0:12000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788909204.565259:0:12000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788909204.568943:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909204.570095:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004824320 00000100:00100000:1.0:1788909204.570121:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004824320 00000100:00100000:1.0:1788909204.570188:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788909204.570198:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10453:x1875807004824320:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788909204.570228:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788909204.570529:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10453:x1875807004824320:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 321us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909204.570538:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1788909204.574192:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909204.575009:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004824448 00000100:00100000:1.0:1788909204.575019:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004824448 00000100:00100000:1.0:1788909204.575082:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1788909204.575092:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10453:x1875807004824448:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788909204.575202:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575219:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575301:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575686:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575695:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575703:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575732:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575741:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575747:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909204.575790:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788909204.575794:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909204.575806:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575816:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575827:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575833:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575838:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909204.575842:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575848:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575859:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:1.0:1788909204.575862:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909204.575865:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575871:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5b15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575882:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575888:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575893:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575897:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909204.575904:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575909:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575916:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff890520ac5e00) 00010000:00010000:1.0:1788909204.575917:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909204.575920:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575924:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5b1c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575949:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575956:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575960:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575965:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909204.575968:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575973:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575980:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293400) 00010000:00010000:1.0:1788909204.575982:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909204.575990:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.575996:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5b23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909204.576089:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10453:x1875807004824448:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 996us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909204.576097:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1788909204.582729:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909204.582781:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004824704 00000100:00100000:0.0:1788909204.582794:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004824704 00000100:00100000:0.0:1788909204.582870:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:0.0:1788909204.582881:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10453:x1875807004824704:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909204.582907:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909204.582933:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5b2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44635 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583046:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583062:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583074:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909204.583086:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788909204.583348:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583358:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583376:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583382:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909204.583387:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583396:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583412:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293400) 00010000:00010000:0.0:1788909204.583416:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788909204.583421:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583427:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583484:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5b2a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44635 expref: 33 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583495:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:0.0:1788909204.583498:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788909204.583502:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5b2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44635 expref: 33 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.583512:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ca00, rc 0) 00000100:00100000:0.0:1788909204.583867:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10453:x1875807004824704:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 985us (1145us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788909204.583886:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:3.0:1788909204.593980:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909204.594162:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004824832 00000100:00100000:0.0:1788909204.594178:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004824832 00000100:00100000:1.0:1788909204.594395:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1788909204.594407:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10453:x1875807004824832:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788909204.594445:0:5824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788909204.594580:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10453:x1875807004824832:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 174us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909204.594587:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1788909204.601578:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909204.601869:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004825088 00000100:00100000:0.0:1788909204.601882:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004825088 00000100:00100000:0.0:1788909204.601969:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:0.0:1788909204.601983:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10453:x1875807004825088:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909204.602015:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909204.602020:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788909204.602065:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5aeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44627 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.602094:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909204.602102:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909204.602152:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5b3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4463c expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788909204.604243:0:7640:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788909204.604589:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.604611:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.604625:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.604711:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5b3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4463c expref: 34 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.605996:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4463c expref: 33 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.606015:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293000) 00010000:00010000:0.0:1788909204.606018:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909204.606022:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d400, rc 0) 00000100:00100000:0.0:1788909204.606199:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10453:x1875807004825088:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4218us (4635us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788909204.606210:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:2.0:1788909204.616287:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909204.616388:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004825344 00000100:00100000:3.0:1788909204.616421:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004825344 00000100:00100000:3.0:1788909204.616479:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1788909204.616491:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10453:x1875807004825344:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788909204.616584:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909204.616621:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5b46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4463c expref: 33 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.616640:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293000) 00010000:00010000:3.0:1788909204.616655:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909204.616682:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.616699:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.616710:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.616773:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.616781:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.616788:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617086:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617095:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617106:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617143:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909204.617149:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617157:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617166:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:3.0:1788909204.617169:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909204.617173:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617179:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5b54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617189:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617195:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617202:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617207:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909204.617210:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617225:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617235:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1d0346ef (ffff890507e13300) 00010000:00010000:3.0:1788909204.617237:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909204.617241:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.617247:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5b5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1d0346ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909204.617371:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10453:x1875807004825344:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 879us (1091us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788909204.617381:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1788909204.619734:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909204.624013:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004825472 00000100:00100000:0.0:1788909204.624036:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004825472 00000100:00100000:0.0:1788909204.624197:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:0.0:1788909204.624208:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10453:x1875807004825472:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909204.624229:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909204.624252:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5b62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44643 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.624288:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.624302:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.624314:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.624419:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5b62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44643 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.624444:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44643 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.624452:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909204.624455:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788909204.624458:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9da00, rc 0) 00000100:00100000:0.0:1788909204.624540:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10453:x1875807004825472:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 333us (4815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909204.624547:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:1.0:1788909204.626780:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909204.626891:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004825728 00000100:00100000:3.0:1788909204.626904:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004825728 00000100:00100000:3.0:1788909204.626976:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1788909204.626989:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10453:x1875807004825728:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788909204.627101:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.627405:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.627419:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788909204.627834:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788909204.627866:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286701755164ns, next at 287701751769ns, rc = 0 00000004:00010000:3.0:1788909204.627984:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000322ee960 reply state 0000000097a8072b transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909204.627995:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788909204.629086:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:10453:x1875807004825728:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2088us (2307us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788909204.629101:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:2.0:1788909204.631553:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:3.0:1788909204.631557:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.631571:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.631580:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.631587:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909204.631591:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.631599:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.631615:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909204.631618:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788909204.631622:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.631628:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5b70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909204.631696:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004825856 00000100:00100000:0.0:1788909204.631707:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004825856 00000100:00100000:0.0:1788909204.631769:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:0.0:1788909204.631780:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:10453:x1875807004825856:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909204.631804:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909204.631820:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4464a expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.631875:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4464a expref: 35 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.631889:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4464a expref: 35 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.631908:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909204.631910:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909204.631919:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ce00, rc 0) 00000100:00100000:0.0:1788909204.631974:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:10453:x1875807004825856:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 196us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909204.631982:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:0.0:1788909204.638535:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909204.638634:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004825984 00000100:00100000:3.0:1788909204.638646:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004825984 00000100:00100000:3.0:1788909204.638704:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788909204.638715:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875807004825984:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788909204.638750:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1788909204.638791:0:6676:0:(genops.c:1385:class_connect()) connect: client 9a693284-9812-4b47-95bb-9bc33a7c4ef4, cookie 0x733cfdd8721d5b7e 00002000:00100000:3.0:1788909204.638806:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9a693284-9812-4b47-95bb-9bc33a7c4ef4/ffff8905180b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788909204.638837:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788909204.639272:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788909204.639312:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8905180b2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788909204.639389:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2346:x1875807004825984:12345-192.168.204.54@tcp:8:lhsmtool_posix.0 Request processed in 673us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909204.639398:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1788909204.644572:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909204.644648:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004826112 00000100:00100000:0.0:1788909204.644660:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004826112 00000100:00100000:0.0:1788909204.644780:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1788909204.644793:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:0:x1875807004826112:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788909204.651330:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788909204.710777:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1788909204.710793:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000100:00100000:0.0:1788909204.711471:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:0:x1875807004826112:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 66670us (66899us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788909204.711485:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1788909204.715672:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909204.715755:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004826368 00000100:00100000:2.0:1788909204.715767:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004826368 00000100:00100000:2.0:1788909204.715833:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:2.0:1788909204.715846:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:10453:x1875807004826368:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788909204.716147:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+36:10453:x1875807004826368:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 304us (490us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788909204.716156:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788909204.723531:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909204.723598:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004826624 00000100:00100000:1.0:1788909204.723611:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004826624 00000100:00100000:1.0:1788909204.723760:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788909204.723771:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+36:10453:x1875807004826624:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788909204.723911:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+36:10453:x1875807004826624:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 142us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909204.727281:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:0.0:1788909204.734568:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909204.734624:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004826752 00000100:00100000:0.0:1788909204.734638:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004826752 00000100:00100000:0.0:1788909204.734708:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:0.0:1788909204.734721:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+36:10453:x1875807004826752:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909204.734742:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909204.734767:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5b85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44651 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.734846:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.734994:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.735014:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909204.735064:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909204.735084:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.735440:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5b85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44651 expref: 38 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.735462:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44651 expref: 37 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.735473:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909204.735477:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788909204.735482:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d200, rc 0) 00000100:00100000:0.0:1788909204.735577:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:10453:x1875807004826752:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 859us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909204.735586:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:3.0:1788909204.741756:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909204.741809:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004826880 00000100:00100000:3.0:1788909204.741819:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004826880 00000100:00100000:3.0:1788909204.741868:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1788909204.741880:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004826880:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788909204.741903:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909204.741929:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44658 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909204.741960:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa09693, blocks: 0x1 00010000:00010000:3.0:1788909204.741990:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1788909204.741995:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909204.742007:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44658 expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.742030:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44658 expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.742046:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9a00, rc 0) 00000100:00100000:3.0:1788909204.742102:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004826880:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 225us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909204.742139:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788909204.756612:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909204.756714:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004827136 00000100:00100000:0.0:1788909204.756725:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004827136 00000100:00100000:0.0:1788909204.756825:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:0.0:1788909204.756835:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:10453:x1875807004827136:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788909204.756975:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:10453:x1875807004827136:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 141us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909204.756983:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:2.0:1788909204.762762:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909204.762800:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004827264 00000100:00100000:2.0:1788909204.762811:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004827264 00000100:00100000:2.0:1788909204.762860:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788909204.762871:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:10453:x1875807004827264:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788909204.762889:0:8092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909204.762910:0:8092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4465f expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.762944:0:8092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44658 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.762953:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909204.762957:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909204.762962:0:8092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 7 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.762994:0:8092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44658 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.763009:0:8092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44658 expref: 7 pid: 6673 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909204.763024:0:8092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8092:1875807019527424:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909204.763137:0:8092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788909204.767619:0:8092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8092:1875807019527424:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788909204.767660:0:8092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 7 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.767698:0:8092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10a00, rc 0) 00000100:00100000:1.0:1788909204.767765:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:10453:x1875807004827264:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4895us (5011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909204.767774:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788909204.771365:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909204.771492:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004827392 00000100:00100000:1.0:1788909204.771502:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004827392 00010000:00010000:1.0:1788909204.771555:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44658 expref: 7 pid: 6673 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909204.771596:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1788909204.771606:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004827392:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909204.771621:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909204.771644:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44658 expref: 7 pid: 6673 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.771658:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44658 expref: 7 pid: 6673 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.771680:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099caf173/0x733cfdd8721d5b93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44658 expref: 7 pid: 6673 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.771697:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909204.771702:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909204.771709:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 6 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.771727:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 6 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.771765:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 6 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909204.771779:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890508ffb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5807:1875807019527552:192.168.204.54@tcp:105: 00000100:00100000:1.0:1788909204.771859:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909204.775657:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909204.775743:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004827520 00000100:00100000:2.0:1788909204.775754:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004827520 00000100:00100000:1.0:1788909204.775776:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890508ffb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5807:1875807019527552:192.168.204.54@tcp:105: 00002000:00100000:2.0:1788909204.775801:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff89052dcc1880 x1875807004827520/t0(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:135/0 lens 504/0 e 0 to 0 dl 1788909215 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788909204.775804:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1788909204.775810:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89052dcc1880 with x1875807004827520 ext(0->8) 00002000:00010000:2.0:1788909204.775814:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89052dcc1880 00000100:00100000:2.0:1788909204.775848:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788909204.775858:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004827520:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788909204.775863:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004827392:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 4261us (4511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909204.775873:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1788909204.777862:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004827520:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 1995us (2208us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788909204.777876:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:2.0:1788909204.777886:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff89052dcc1880 x1875807004827520/t4294967302(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:135/0 lens 504/448 e 0 to 0 dl 1788909215 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788909204.777896:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89052dcc1880 with x1875807004827520 ext(0->8) 00002000:00010000:2.0:1788909204.777902:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89052dcc1880 00000100:00100000:3.0:1788909204.783415:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909204.783490:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004827648 00000100:00100000:0.0:1788909204.783533:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004827648 00000100:00100000:0.0:1788909204.783621:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:0.0:1788909204.783634:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:10453:x1875807004827648:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788909204.823052:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:10453:x1875807004827648:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 39404us (39638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909204.823066:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000001:00080000:3.0:1788909204.823084:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:3.0:1788909204.823139:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1788909204.823170:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1788909204.823193:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788909204.823225:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788909204.823240:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788909204.823358:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788909204.823380:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019527680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788909204.823472:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909204.823498:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019527680 00000100:00100000:1.0:1788909204.823510:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019527680 00000100:00080000:3.0:1788909204.823561:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909204.823585:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788909204.823595:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019527680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788909204.823787:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788909204.823790:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788909204 00002000:00010000:1.0:1788909204.823806:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788909204.823808:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788909203 -> 1788909204 00002000:00010000:1.0:1788909204.823810:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788909204.823853:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019527680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 259us (381us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788909204.823860:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1788909204.827560:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89052dcb0e00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788909204.827590:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019527680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788909204.829688:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909204.830152:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004827776 00000100:00100000:2.0:1788909204.830169:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004827776 00000100:00100000:2.0:1788909204.830254:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1788909204.830264:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2347:x1875807004827776:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788909204.885995:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788909204.886409:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788909204.889776:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004827776:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 59501us (60091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909204.889790:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1788909204.892755:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909204.893018:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004828032 00000100:00100000:1.0:1788909204.893028:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004828032 00000100:00100000:1.0:1788909204.893091:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:1.0:1788909204.893148:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:10453:x1875807004828032:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788909204.893222:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909204.893255:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5b8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44651 expref: 13 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.893284:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:1.0:1788909204.893290:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788909204.893332:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.893348:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.893359:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788909204.893666:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007912cdb9 reply state 00000000cedfbc93 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909204.893696:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788909204.893800:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10453:x1875807004828032:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 700us (1058us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788909204.893809:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00010000:00010000:0.0:1788909204.900402:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.900421:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.900429:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.900434:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909204.900439:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.900447:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.900474:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909204.900478:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909204.900483:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.900489:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5ba1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909204.903050:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909204.903364:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004828160 00000100:00100000:3.0:1788909204.903374:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004828160 00000100:00100000:3.0:1788909204.903433:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1788909204.903458:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004828160:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788909204.903879:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788909204.903883:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788909204 -> 1788909202 00002000:00010000:3.0:1788909204.903886:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788909201 00002000:00010000:3.0:1788909204.903888:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788909204 -> 1788909202 00002000:00010000:3.0:1788909204.903890:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788909204.904093:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004828160:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 636us (1050us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788909204.904103:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1788909204.909238:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909204.910798:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004828416 00000100:00100000:2.0:1788909204.910812:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004828416 00000100:00100000:2.0:1788909204.910937:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1788909204.910948:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:10453:x1875807004828416:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788909204.911032:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.911049:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44643 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.911058:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.911091:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44643 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.911105:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44643 expref: 13 pid: 5823 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909204.911168:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e57800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019527808:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909204.911275:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909204.915351:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e57800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019527808:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909204.915387:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909204.917367:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909204.917986:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004828544 00000100:00100000:2.0:1788909204.917998:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004828544 00010000:00010000:2.0:1788909204.918043:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44643 expref: 14 pid: 5823 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909204.918083:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1788909204.918092:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2350:x1875807004828544:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909204.918105:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909204.918143:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44643 expref: 14 pid: 5823 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.918174:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44643 expref: 14 pid: 5823 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.918200:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5b69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44643 expref: 14 pid: 5823 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.918341:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909204.918348:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.918359:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.918367:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.918403:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909204.918470:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:2350:x1875807004828544:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 378us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909204.918478:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00010000:00010000:0.0:1788909204.918566:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.918575:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.918613:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.918621:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.918628:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.918634:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909204.918639:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.918646:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.918655:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909204.918657:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788909204.918661:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909204.918667:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5ba8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909204.918710:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:10453:x1875807004828416:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 7765us (9483us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788909204.918725:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:0.0:1788909204.925065:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909204.925301:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004828672 00000100:00100000:1.0:1788909204.925318:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004828672 00000100:00100000:1.0:1788909204.925385:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:1.0:1788909204.925396:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2347:x1875807004828672:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788909204.925442:0:8092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.925473:0:8092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 7 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.925481:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909204.925486:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788909204.925491:0:8092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.925536:0:8092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 7 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.925557:0:8092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 7 pid: 8092 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909204.925572:0:8092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890508ffb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8092:1875807019527936:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909204.925663:0:8092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788909204.928647:0:8092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890508ffb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8092:1875807019527936:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909204.928674:0:8092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909204.929666:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909204.929754:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004828800 00000100:00100000:3.0:1788909204.929761:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004828800 00010000:00010000:3.0:1788909204.929808:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 8 pid: 8092 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909204.930059:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788909204.930069:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2349:x1875807004828800:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909204.930085:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909204.930139:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 8 pid: 8092 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.930171:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 8 pid: 8092 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.930196:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007076b019/0x733cfdd8721d5b9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4465f expref: 8 pid: 8092 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.930212:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788909204.930217:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788909204.930223:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.930232:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.930264:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909204.930318:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004828800:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 250us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909204.930326:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00010000:00010000:2.0:1788909204.930393:0:8092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.930414:0:8092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.930442:0:8092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.930451:0:8092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.930465:0:8092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.930472:0:8092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909204.930476:0:8092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.930485:0:8092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.930498:0:8092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.930505:0:8092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eac72c9/0x733cfdd8721d5baf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909204.933932:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004828672:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 8527us (8867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909204.933946:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1788909204.938342:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909204.938612:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004829056 00000100:00100000:3.0:1788909204.938625:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004829056 00000100:00100000:3.0:1788909204.938693:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:3.0:1788909204.938704:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:10453:x1875807004829056:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788909204.938792:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.938813:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.938846:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.939069:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.939081:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4464a expref: 13 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.939089:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.939164:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4464a expref: 13 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.939180:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4464a expref: 13 pid: 7640 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909204.939195:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019528064:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909204.939289:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788909204.943880:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909204.943940:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004829184 00000100:00100000:2.0:1788909204.943952:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004829184 00010000:00010000:2.0:1788909204.944148:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4464a expref: 14 pid: 7640 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909204.944196:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:2.0:1788909204.944206:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2349:x1875807004829184:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909204.944222:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909204.944229:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4464a expref: 14 pid: 7640 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.944243:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4464a expref: 14 pid: 7640 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.944268:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909204.944274:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.944285:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.944294:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.944545:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909204.944604:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2349:x1875807004829184:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 399us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909204.944612:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00010000:00010000:3.0:1788909204.947383:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5b77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4464a expref: 13 pid: 7640 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909204.947415:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019528064:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909204.947454:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.947545:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.947555:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788909204.947794:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788909204.948374:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788909204.948423:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788909204.948528:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875807019528192:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788909204.948606:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909204.948750:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019528192 00000100:00100000:3.0:1788909204.948770:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019528192 00000100:00100000:2.0:1788909204.948799:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909204.948879:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788909204.948891:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1875807019528192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788909204.948998:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1875807019528192:12345-0@lo:1000:mdt00_002.0 Request processed in 109us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909204.949006:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788909204.949247:0:5824:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788909204.949253:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89052dcb0e00, transno 4294967303 00000100:00100000:2.0:1788909204.949390:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875807019528192:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788909204.949890:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788909204.949955:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875807019528320:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788909204.950015:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909204.951242:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788909204.951606:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019528320 00000100:00100000:1.0:1788909204.951614:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019528320 00000100:00100000:1.0:1788909204.951655:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788909204.951661:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875807019528320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788909204.951984:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1875807019528320:12345-0@lo:1000:mdt00_002.0 Request processed in 321us (1968us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788909204.951993:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788909204.952045:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875807019528320:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788909204.952083:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952136:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952143:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952148:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909204.952153:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952315:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952333:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909204.952336:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788909204.952341:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952347:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bbd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952386:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952393:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952399:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952404:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909204.952412:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952419:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952428:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293400) 00010000:00010000:2.0:1788909204.952430:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788909204.952434:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952439:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5af2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952490:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952507:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4462e expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952528:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952568:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4462e expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.952585:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4462e expref: 16 pid: 5822 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909204.952605:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e57800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019528448:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909204.952704:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909204.958546:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909204.958629:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004829312 00000100:00100000:1.0:1788909204.958639:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004829312 00010000:00010000:1.0:1788909204.958680:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4462e expref: 17 pid: 5822 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909204.958721:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788909204.958732:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537406d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:2349:x1875807004829312:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909204.958748:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909204.958754:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4462e expref: 17 pid: 5822 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.958766:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4462e expref: 17 pid: 5822 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.958787:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293400) 00010000:00010000:1.0:1788909204.958792:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.958801:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.958822:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909204.958843:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909204.958945:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537406d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:2349:x1875807004829312:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 214us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909204.958952:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00010000:00010000:2.0:1788909204.959077:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5b0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4462e expref: 16 pid: 5822 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909204.959094:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e57800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019528448:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909204.959182:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959191:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959197:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959207:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959213:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959218:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959224:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909204.959227:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959234:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959244:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293400) 00010000:00010000:2.0:1788909204.959246:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909204.959257:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959264:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5bc4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959275:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959280:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959285:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959290:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909204.959293:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959299:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959307:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293400) 00010000:00010000:2.0:1788909204.959309:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788909204.959312:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.959316:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5bb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788909204.959593:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909204.959597:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909204.959623:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788909204.959635:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788909204.959699:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:10453:x1875807004829056:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 20995us (21368us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788909204.959706:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000020:00080000:2.0:1788909204.959710:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788909204.962556:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909204.962629:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004829568 00000100:00100000:2.0:1788909204.962638:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004829568 00000100:00100000:2.0:1788909204.962694:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788909204.962704:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:10453:x1875807004829568:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788909204.963410:0:5825:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788909204.963526:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788909204.963573:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.963588:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.963599:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.963606:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.963611:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.963617:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909204.967065:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788909204.967264:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:10453:x1875807004829568:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 4555us (4709us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788909204.967289:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000020:00080000:2.0:1788909204.967295:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788909204.968024:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909204.968036:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.968048:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11e00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909204.968052:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.968060:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.968078:0:6689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff890510293100) 00010000:00010000:3.0:1788909204.968081:0:6689:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788909204.968085:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.968091:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d5bcb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909204.968180:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909204.968183:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909204.968185:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909205.190540:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909206.213404:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788909206.337782:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909206.337796:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909206.337858:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788909206.337878:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788909206.452358:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909206.452409:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004829824 00000100:00100000:1.0:1788909206.452420:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004829824 00000100:00100000:1.0:1788909206.452504:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:1.0:1788909206.452515:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:10471:x1875807004829824:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788909206.452544:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909206.452563:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44666 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.452824:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5bd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.452838:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.452849:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5bd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909206.452860:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1788909206.453204:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44666 expref: 20 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.453220:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5bd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44666 expref: 19 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.453237:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:1.0:1788909206.453240:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788909206.453244:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890501693600, rc 0) 00000100:00100000:1.0:1788909206.453312:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10471:x1875807004829824:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 799us (961us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788909206.453319:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00080000:0.0:1788909206.453725:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909206.458616:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909206.458656:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004829952 00000100:00100000:3.0:1788909206.458671:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004829952 00000100:00100000:3.0:1788909206.458726:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1788909206.458736:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10471:x1875807004829952:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:3.0:1788909206.458819:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.458836:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.458847:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.458863:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.458871:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.458878:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459543:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459554:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459563:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788909206.459606:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459630:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459636:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459644:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459650:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909206.459654:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459662:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459675:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:3.0:1788909206.459678:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909206.459682:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459688:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5be7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459700:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459705:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459711:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459720:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909206.459723:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459728:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459736:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890507e13e00) 00010000:00010000:3.0:1788909206.459738:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909206.459741:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459746:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5bee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459758:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459763:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459769:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459773:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909206.459776:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459782:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459797:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890507e13800) 00010000:00010000:3.0:1788909206.459800:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909206.459803:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.459809:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5bf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909206.459891:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10471:x1875807004829952:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1155us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909206.459901:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1788909206.525351:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909206.525536:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004830208 00000100:00100000:1.0:1788909206.525553:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004830208 00000100:00100000:1.0:1788909206.525617:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:1.0:1788909206.525628:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10474:x1875807004830208:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788909206.525648:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909206.525669:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5bfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4466d expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.525742:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.525757:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.525767:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.525786:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.525793:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.525820:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526551:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526562:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526571:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909206.526581:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788909206.526676:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526684:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526690:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526697:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909206.526701:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526709:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526722:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:1.0:1788909206.526725:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909206.526736:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526742:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692000/0x733cfdd8721d5c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526757:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526763:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526769:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526773:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909206.526776:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526781:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526788:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890520ac5800) 00010000:00010000:1.0:1788909206.526790:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909206.526792:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526798:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501692c00/0x733cfdd8721d5c0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.526848:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693e00/0x733cfdd8721d5bfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4466d expref: 22 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.527252:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4466d expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.527262:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:1.0:1788909206.527264:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909206.527267:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768600, rc 0) 00000100:00100000:1.0:1788909206.527403:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10474:x1875807004830208:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1776us (2065us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788909206.527413:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:0.0:1788909206.538762:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909206.539844:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004830336 00000100:00100000:3.0:1788909206.539860:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004830336 00000100:00100000:3.0:1788909206.540181:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:3.0:1788909206.540193:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10474:x1875807004830336:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788909206.540279:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.540298:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.540310:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.540341:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.540347:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.540375:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.540380:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909206.540385:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.540392:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.540404:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:3.0:1788909206.540408:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788909206.540412:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.540418:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5c1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909206.540526:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10474:x1875807004830336:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 334us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909206.540534:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:3.0:1788909206.544630:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909206.544725:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004830592 00000100:00100000:2.0:1788909206.544737:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004830592 00000100:00100000:2.0:1788909206.544800:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788909206.544811:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10474:x1875807004830592:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909206.545470:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:10474:x1875807004830592:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 657us (847us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788909206.545491:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788909206.593169:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909206.594088:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004830848 00000100:00100000:2.0:1788909206.594103:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004830848 00000100:00100000:2.0:1788909206.594222:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1788909206.594233:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:9995:x1875807004830848:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909206.594261:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909206.594284:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d5c26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44674 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.594443:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.594462:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4466d expref: 23 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.594507:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.594554:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4466d expref: 23 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.594570:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4466d expref: 23 pid: 7640 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909206.594587:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e57800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019528576:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909206.594730:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909206.598838:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e57800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019528576:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909206.598866:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909206.602689:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909206.602872:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004830976 00000100:00100000:2.0:1788909206.602998:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004830976 00010000:00010000:2.0:1788909206.603058:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4466d expref: 24 pid: 7640 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909206.603324:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1788909206.603337:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:2350:x1875807004830976:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909206.603359:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909206.603368:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4466d expref: 24 pid: 7640 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.603408:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4466d expref: 24 pid: 7640 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.603437:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4466d expref: 24 pid: 7640 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.603462:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:2.0:1788909206.603467:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.603546:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.603557:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.603605:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909206.604202:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.604372:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909206.604405:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788909206.604686:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d5c26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44674 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.604723:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44674 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.604731:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:3.0:1788909206.604735:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788909206.604738:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11400, rc 0) 00000100:00100000:3.0:1788909206.604824:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:9995:x1875807004830848:12345-192.168.204.54@tcp:101:bash.0 Request processed in 10593us (11666us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788909206.604833:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1788909206.605560:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:2350:x1875807004830976:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 2218us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909206.605575:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1788909206.610321:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909206.610441:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004831232 00000100:00100000:2.0:1788909206.610473:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004831232 00000100:00100000:2.0:1788909206.610986:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:2.0:1788909206.611001:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:9995:x1875807004831232:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1788909206.611592:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.611618:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.611652:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788909206.611721:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788909206.611750:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5cb5695 reply state 0000000063341e50 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909206.612081:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788909206.612191:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788909206.612347:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:9995:x1875807004831232:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1345us (2046us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788909206.612357:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000020:00080000:2.0:1788909206.612365:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788909206.615047:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909206.615143:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004831360 00010000:00010000:1.0:1788909206.615972:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.615989:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.615998:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.616005:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909206.616011:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.616020:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.616044:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:1.0:1788909206.616047:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909206.616053:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.616082:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5c3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909206.617727:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004831360 00000100:00100000:0.0:1788909206.617858:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1788909206.617872:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:9995:x1875807004831360:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788909206.617913:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909206.617943:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5c42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4467b expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.618043:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5c42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4467b expref: 27 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.618062:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5c42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4467b expref: 27 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.618133:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:0.0:1788909206.618138:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909206.618143:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ce00, rc 0) 00000100:00100000:0.0:1788909206.618376:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:9995:x1875807004831360:12345-192.168.204.54@tcp:101:bash.0 Request processed in 388us (3224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909206.618386:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:1.0:1788909206.619391:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909206.619436:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909206.619469:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909206.619510:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909206.619523:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004831744 00000100:00100000:1.0:1788909206.619534:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004831872 00000100:00100000:2.0:1788909206.619535:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004831744 00000100:00100000:1.0:1788909206.619537:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004831872 00000100:00100000:3.0:1788909206.619588:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004831488 00000100:00100000:3.0:1788909206.619593:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004831488 00000100:00100000:2.0:1788909206.619593:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004831616 00000100:00100000:2.0:1788909206.619596:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004831616 00000100:00100000:3.0:1788909206.619697:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 279 00000100:00100000:3.0:1788909206.619709:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004831488:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909206.619772:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004831488:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 67us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909206.619778:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 279 00000100:00100000:3.0:1788909206.619913:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1788909206.619921:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004831744:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909206.619959:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004831744:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 39us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909206.619967:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788909206.620237:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:1.0:1788909206.620246:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004831872:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909206.620280:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004831872:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909206.620288:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:2.0:1788909206.623152:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1788909206.623177:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004831616:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909206.623296:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004831616:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 128us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909206.623304:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00080000:3.0:1788909206.624032:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788909206.624994:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909206.625175:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004832000 00000100:00100000:3.0:1788909206.625208:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004832000 00000100:00100000:2.0:1788909206.625649:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1788909206.625664:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:9995:x1875807004832000:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909206.625689:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909206.625719:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44682 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909206.625765:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa09692, atime: 0x6aa09691, ctime: 0x6aa09692, blocks: 0xb 00010000:00010000:2.0:1788909206.625794:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1788909206.625800:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909206.625811:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44682 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.625852:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44682 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.625871:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909206.625938:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:9995:x1875807004832000:12345-192.168.204.54@tcp:101:bash.0 Request processed in 278us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909206.625946:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00080000:1.0:1788909206.626009:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788909206.626017:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909206.629236:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909206.629363:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004832128 00000100:00100000:0.0:1788909206.629376:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004832128 00002000:00010000:0.0:1788909206.629447:0:6679:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788909206.629452:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff890504e54380 with x1875807004832128 ext(0->18446744073709551615) 00002000:00010000:0.0:1788909206.629466:0:6679:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890504e54380. 00000100:00100000:1.0:1788909206.629725:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1788909206.629737:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004832128:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:1.0:1788909206.630048:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788909206.630051:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788909202 -> 1788909205 00002000:00010000:1.0:1788909206.630054:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788909201 -> 1788909201 00002000:00010000:1.0:1788909206.630056:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788909202 -> 1788909205 00002000:00010000:1.0:1788909206.630058:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788909206.630181:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004832128:12345-192.168.204.54@tcp:10:bash.0 Request processed in 445us (957us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788909206.630206:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00010000:1.0:1788909206.630210:0:6679:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788909206.630213:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff890504e54380 with x1875807004832128 ext(0->18446744073709551615) 00002000:00010000:1.0:1788909206.630219:0:6679:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890504e54380. 00000100:00100000:1.0:1788909206.661701:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019528704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909206.661782:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909206.662053:0:11699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019528704 00000100:00100000:3.0:1788909206.662062:0:11699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019528704 00000100:00100000:3.0:1788909206.662166:0:11699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788909206.662177:0:11699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875807019528704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909206.662228:0:11699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788909206.662306:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909206.662593:0:11699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875807019528704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 411us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909206.662602:0:11699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788909206.662719:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019528704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909206.688986:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909206.689505:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004832256 00000100:00100000:0.0:1788909206.689524:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004832256 00000100:00100000:0.0:1788909206.689855:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1788909206.689869:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:10488:x1875807004832256:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1788909206.689970:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.689990:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690002:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690031:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690039:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690062:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690468:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690489:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690498:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788909206.690553:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690568:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690574:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690582:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690588:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909206.690593:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690601:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690614:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909206.690624:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909206.690629:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690635:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5c50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690653:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690658:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690663:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690667:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909206.690669:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690675:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690681:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890513293800) 00010000:00010000:0.0:1788909206.690683:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909206.690685:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690689:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5c57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690702:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690712:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690717:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690721:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909206.690724:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690734:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690741:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:0.0:1788909206.690744:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909206.690747:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.690752:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5c5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909206.690842:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:10488:x1875807004832256:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 975us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909206.690850:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:2.0:1788909206.748883:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909206.749727:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004832512 00000100:00100000:1.0:1788909206.749739:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004832512 00000100:00100000:1.0:1788909206.749806:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1788909206.749824:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:10491:x1875807004832512:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788909206.749850:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909206.749877:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769e00/0x733cfdd8721d5c65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44689 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.749973:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750002:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750014:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750029:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750062:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750068:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750443:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d5c7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750453:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d5c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750460:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d5c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909206.750472:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788909206.750591:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750599:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750607:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750612:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909206.750618:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750625:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750649:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:1.0:1788909206.750652:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909206.750658:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750664:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750677:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750683:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750688:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750692:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909206.750695:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750701:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750707:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890520ac5800) 00010000:00010000:1.0:1788909206.750709:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909206.750711:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750716:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750767:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769e00/0x733cfdd8721d5c65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44689 expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750780:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d5c7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44689 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.750788:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:1.0:1788909206.750790:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788909206.750793:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769600, rc 0) 00000100:00100000:1.0:1788909206.750880:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10491:x1875807004832512:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1057us (2012us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788909206.750889:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:2.0:1788909206.759916:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909206.765182:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004832640 00000100:00100000:3.0:1788909206.765198:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004832640 00000100:00100000:3.0:1788909206.765900:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:3.0:1788909206.765917:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10491:x1875807004832640:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788909206.766004:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.766021:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44674 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.766032:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.766206:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44674 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909206.766223:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44674 expref: 29 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909206.766887:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d423100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019528832:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909206.767140:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788909206.780682:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d423100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019528832:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909206.780709:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909206.783650:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909206.783746:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004832896 00000100:00100000:0.0:1788909206.783756:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004832896 00000100:00100000:0.0:1788909206.783827:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1788909206.783837:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:5589:x1875807004832896:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788909206.784291:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:5589:x1875807004832896:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 453us (649us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788909206.784316:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1788909206.797264:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909206.797550:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004833024 00000100:00100000:1.0:1788909206.797562:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004833024 00010000:00010000:1.0:1788909206.797609:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44674 expref: 31 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909206.797656:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1788909206.797667:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:2350:x1875807004833024:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909206.797682:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909206.797688:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44674 expref: 31 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.797702:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44674 expref: 31 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.797743:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d5c2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44674 expref: 31 pid: 5822 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.797761:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:1.0:1788909206.797766:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.797776:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.797783:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.797820:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909206.797873:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:2350:x1875807004833024:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 207us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909206.797881:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00010000:00010000:2.0:1788909206.798009:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.798016:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.798063:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.798080:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.798087:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.798095:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909206.798100:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.798146:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.798158:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:2.0:1788909206.798161:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909206.798165:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909206.798171:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5c88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909206.798214:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10491:x1875807004832640:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 32304us (38311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909206.798222:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:3.0:1788909206.813192:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909206.813298:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004833280 00000100:00100000:0.0:1788909206.813308:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004833280 00000100:00100000:0.0:1788909206.813373:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788909206.813385:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:10491:x1875807004833280:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788909206.813660:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10491:x1875807004833280:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 276us (491us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788909206.813666:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:0.0:1788909206.933573:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909206.933655:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004833536 00000100:00100000:1.0:1788909206.933668:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004833536 00000100:00100000:1.0:1788909206.933781:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:1.0:1788909206.933795:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+30:10502:x1875807004833536:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1788909206.933837:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909206.933864:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44690 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.933946:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.933978:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.933991:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934006:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934013:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934020:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934451:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934462:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934469:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909206.934493:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788909206.934605:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934613:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934620:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934633:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909206.934638:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934645:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934659:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:1.0:1788909206.934662:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909206.934666:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934672:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5c96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934686:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934690:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934696:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934701:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909206.934704:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934711:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934729:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890520ac5800) 00010000:00010000:1.0:1788909206.934731:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909206.934734:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934740:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5c9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934792:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5c8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44690 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934806:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44690 expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.934813:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:1.0:1788909206.934816:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909206.934818:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769c00, rc 0) 00000100:00100000:1.0:1788909206.934894:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10502:x1875807004833536:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1103us (1333us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788909206.934904:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:1.0:1788909206.942801:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909206.942943:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004833792 00000100:00100000:0.0:1788909206.942953:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004833792 00000100:00100000:0.0:1788909206.943018:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788909206.943027:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10502:x1875807004833792:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:0.0:1788909206.943361:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10502:x1875807004833792:12345-192.168.204.54@tcp:35:cat.0 Request processed in 334us (568us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788909206.943369:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1788909206.976904:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909206.978154:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004834048 00000100:00100000:0.0:1788909206.982323:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004834048 00000100:00100000:0.0:1788909206.982740:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:0.0:1788909206.982753:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10503:x1875807004834048:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:0.0:1788909206.982829:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788909206.982863:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44690 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.982888:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d5c7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44689 expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.982921:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5c42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4467b expref: 31 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.982933:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890520ac5e00) 00010000:00010000:0.0:1788909206.982944:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909206.982971:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.982986:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.982997:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.983014:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.983022:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.983029:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.984787:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.984809:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.984823:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788909206.987898:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788909206.987919:0:7640:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289061808037ns, next at 290061803028ns, rc = 0 00010000:00010000:0.0:1788909206.988023:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988048:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988064:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988074:0:7640:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988082:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988089:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988174:0:7640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788909206.988210:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988218:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988225:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988231:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909206.988247:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988255:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988272:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293d00) 00010000:00010000:0.0:1788909206.988275:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788909206.988281:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988287:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5cc0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988313:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988319:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988325:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988330:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909206.988333:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988339:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988347:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909206.988350:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909206.988361:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.988367:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788909206.988380:0:7640:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fcc0984 reply state 000000008c17f0bc transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909206.988393:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788909206.988648:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909206.988659:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.988666:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9da00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909206.988670:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.988688:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.988697:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff890513293d00) 00010000:00010000:1.0:1788909206.988700:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788909206.988703:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.988709:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5cc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909206.988730:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909206.988731:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909206.988733:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909206.990510:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:10503:x1875807004834048:12345-192.168.204.54@tcp:36:rm.0 Request processed in 7747us (13607us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788909206.990524:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00010000:00010000:0.0:1788909206.996971:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.997001:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.997010:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.997017:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909206.997024:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.997034:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.997060:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890513293800) 00010000:00010000:0.0:1788909206.997064:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909206.997069:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909206.997105:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909207.053292:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.053783:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004834304 00000100:00100000:0.0:1788909207.053793:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004834304 00000100:00100000:0.0:1788909207.053865:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:0.0:1788909207.053877:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:10509:x1875807004834304:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788909207.053901:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909207.053932:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44697 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.054068:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.054406:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.054421:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.055287:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.055307:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.055317:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788909207.057382:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788909207.058210:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058236:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058251:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058318:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058326:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058333:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058339:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909207.058344:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058353:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058365:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:2.0:1788909207.058368:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909207.058373:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058396:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5cd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909207.058414:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092a7bb01 reply state 00000000a23c1cc7 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909207.058426:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788909207.058484:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5cce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44697 expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058566:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44697 expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.058575:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890510293f00) 00010000:00010000:2.0:1788909207.058577:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909207.058580:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11a00, rc 0) 00000100:00100000:2.0:1788909207.058693:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:10509:x1875807004834304:12345-192.168.204.54@tcp:101:bash.0 Request processed in 4818us (5414us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788909207.058704:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00010000:00010000:2.0:1788909207.061401:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.061419:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.061428:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.061439:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909207.061463:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.061483:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.061503:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890510293100) 00010000:00010000:2.0:1788909207.061507:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909207.061514:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.061521:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d5cdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909207.069987:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.070095:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004834432 00000100:00100000:2.0:1788909207.070132:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004834432 00000100:00100000:2.0:1788909207.070361:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:2.0:1788909207.070373:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2348:x1875807004834432:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909207.070391:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909207.070416:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4469e expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909207.070450:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909207.070486:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=289s v=(0 0) 00010000:00010000:2.0:1788909207.070498:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909207.070513:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4469e expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.070538:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4469e expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.070575:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11400, rc 0) 00000100:00100000:2.0:1788909207.070640:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2348:x1875807004834432:12345-192.168.204.54@tcp:101:bash.0 Request processed in 269us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909207.070647:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:1.0:1788909207.077383:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909207.077888:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004834560 00000100:00100000:3.0:1788909207.077901:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004834560 00000100:00100000:3.0:1788909207.077984:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1788909207.077997:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:10509:x1875807004834560:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788909207.078020:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909207.078310:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446a5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.078355:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4469e expref: 9 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.078365:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909207.078371:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909207.078375:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.078417:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4469e expref: 9 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.078457:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4469e expref: 9 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909207.078491:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d423b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1875807019528960:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909207.079278:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788909207.082984:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d423b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1875807019528960:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909207.083021:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.083043:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9a00, rc 0) 00000100:00100000:3.0:1788909207.083144:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:10509:x1875807004834560:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5149us (5775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909207.083154:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:2.0:1788909207.084659:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.084748:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004834688 00000100:00100000:0.0:1788909207.084758:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004834688 00010000:00010000:0.0:1788909207.084798:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4469e expref: 9 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.084934:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1788909207.084945:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2350:x1875807004834688:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909207.084962:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909207.085010:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4469e expref: 9 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.085025:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4469e expref: 9 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.085301:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d5cf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4469e expref: 9 pid: 6675 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.085326:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909207.085330:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909207.085341:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.085352:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.085391:0:8451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.085406:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537405500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1875807019529088:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788909207.085490:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909207.092067:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.092345:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537405500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8451:1875807019529088:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788909207.092380:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909207.092453:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004834688:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 7509us (7799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909207.092505:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1788909207.094009:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004834944 00000100:00100000:2.0:1788909207.094025:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004834944 00000100:00100000:2.0:1788909207.094192:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:2.0:1788909207.094206:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:10509:x1875807004834944:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:2.0:1788909207.094647:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:10509:x1875807004834944:12345-192.168.204.54@tcp:35:bash.0 Request processed in 443us (2592us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788909207.094655:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00010000:00010000:1.0:1788909207.237441:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909207.272396:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.272564:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004835072 00000100:00100000:2.0:1788909207.272575:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004835072 00000100:00100000:2.0:1788909207.272639:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:2.0:1788909207.272649:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:10525:x1875807004835072:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909207.272674:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909207.272696:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d5cff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446ac expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.272761:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5d06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.272775:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.272804:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909207.272863:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788909207.272867:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909207.272897:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.272933:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d5cff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446ac expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.272954:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5d06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446ac expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.272964:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:2.0:1788909207.272967:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909207.272971:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11c00, rc 0) 00000100:00100000:2.0:1788909207.273037:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:10525:x1875807004835072:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 389us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909207.273045:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:1.0:1788909207.278433:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909207.278525:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004835328 00000100:00100000:3.0:1788909207.278535:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004835328 00000100:00100000:3.0:1788909207.278593:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:3.0:1788909207.278603:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:10525:x1875807004835328:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909207.278624:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909207.278646:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5d0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446b3 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.278763:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5d14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.278794:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.278806:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909207.278818:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788909207.278957:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5d0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446b3 expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.278978:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446b3 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.278986:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890510293f00) 00010000:00010000:3.0:1788909207.278989:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788909207.278992:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9e00, rc 0) 00000100:00100000:3.0:1788909207.279057:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:10525:x1875807004835328:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 455us (633us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788909207.279064:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:3.0:1788909207.286015:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.286318:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004835584 00000100:00100000:2.0:1788909207.286331:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004835584 00000100:00100000:2.0:1788909207.286458:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:2.0:1788909207.286480:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:10525:x1875807004835584:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909207.286508:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909207.286532:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d5d22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446ba expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.286780:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5d29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.286799:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.286812:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909207.286826:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788909207.286956:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d5d22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446ba expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.286977:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5d29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446ba expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.286986:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890510293f00) 00010000:00010000:2.0:1788909207.286989:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788909207.286993:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11000, rc 0) 00000100:00100000:2.0:1788909207.287066:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+39:10525:x1875807004835584:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 599us (1061us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788909207.287074:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:1.0:1788909207.288460:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909207.288546:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004835712 00000100:00100000:3.0:1788909207.288556:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004835712 00000100:00100000:3.0:1788909207.288626:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1788909207.288638:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+39:2347:x1875807004835712:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909207.288658:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909207.288689:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5d14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446b3 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.288733:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890510293f00) 00010000:00010000:3.0:1788909207.288738:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909207.288794:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+38:2347:x1875807004835712:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 159us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909207.288802:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788909207.298653:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.298771:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004835840 00000100:00100000:0.0:1788909207.298781:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004835840 00000100:00100000:0.0:1788909207.298883:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1788909207.298894:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2349:x1875807004835840:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:0.0:1788909207.298958:0:8092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.298984:0:8092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.298992:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909207.298996:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909207.299001:0:8092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.299043:0:8092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.299057:0:8092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 8 pid: 6673 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.299071:0:8092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537404380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8092:1875807019529216:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909207.299206:0:8092:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82780 going to sleep for 11 seconds 00000100:00100000:0.0:1788909207.301482:0:8092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537404380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8092:1875807019529216:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909207.301531:0:8092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909207.304039:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.304149:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004835968 00000100:00100000:2.0:1788909207.304160:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004835968 00002000:00100000:2.0:1788909207.304224:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff890508ff8a80 x1875807004835968/t0(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:138/0 lens 504/0 e 0 to 0 dl 1788909218 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788909207.304234:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff890508ff8a80 with x1875807004835968 ext(0->8) 00010000:00010000:2.0:1788909207.304259:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 9 pid: 6673 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.304275:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 9 pid: 6673 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909207.304283:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff890508ff8a80 00000100:00100000:2.0:1788909207.304313:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788909207.304323:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2349:x1875807004835968:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:2.0:1788909207.304854:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:2349:x1875807004835968:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 531us (822us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788909207.304862:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00002000:00100000:2.0:1788909207.304868:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff890508ff8a80 x1875807004835968/t4294967302(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:138/0 lens 504/448 e 0 to 0 dl 1788909218 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788909207.304875:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff890508ff8a80 with x1875807004835968 ext(0->8) 00010000:00010000:2.0:1788909207.304881:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 11 pid: 6673 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.304893:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 11 pid: 6673 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909207.304899:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff890508ff8a80 00000100:00100000:3.0:1788909207.307851:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.308066:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004836096 00000100:00100000:2.0:1788909207.308194:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004836096 00010000:00010000:2.0:1788909207.308259:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 11 pid: 6673 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909207.308328:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1788909207.308340:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:2350:x1875807004836096:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909207.308359:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788909207.308381:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788909207.308384:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788909206 00002000:00010000:2.0:1788909207.308386:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788909206 00002000:00010000:2.0:1788909207.308388:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788909206 00010000:00010000:2.0:1788909207.308394:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 11 pid: 6673 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.308408:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 11 pid: 6673 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.308431:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099caf173/0x733cfdd8721d5cf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a446a5 expref: 11 pid: 6673 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.308452:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788909207.308457:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788909207.308464:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.308486:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.308537:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788909207.308689:0:8092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.308699:0:8092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.308727:0:8092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.308743:0:8092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.308750:0:8092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.308756:0:8092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d400 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909207.308760:0:8092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.308769:0:8092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.308782:0:8092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.308789:0:8092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d5d37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909207.308858:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:2350:x1875807004836096:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 519us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909207.308866:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1788909207.311649:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2349:x1875807004835840:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 12736us (12987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909207.311670:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:1.0:1788909207.315074:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.315220:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004836352 00000100:00100000:0.0:1788909207.315235:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004836352 00000100:00100000:0.0:1788909207.315311:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1788909207.315324:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+38:10525:x1875807004836352:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:0.0:1788909207.315404:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5d29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446ba expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788909207.315759:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788909207.315804:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788909207.316339:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788909207.316407:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.316429:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44697 expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.316439:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.316493:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44697 expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.316507:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44697 expref: 42 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.316523:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537404380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875807019529344:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909207.316624:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82780 going to sleep for 11 seconds 00000100:00100000:3.0:1788909207.320158:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909207.320272:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004836480 00000100:00100000:1.0:1788909207.320289:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004836480 00010000:00010000:1.0:1788909207.320379:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44697 expref: 43 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909207.320437:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1788909207.320450:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+43:2349:x1875807004836480:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909207.320478:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909207.320486:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44697 expref: 43 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.320502:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44697 expref: 43 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.320531:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890510293f00) 00010000:00010000:1.0:1788909207.320537:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.320549:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.320557:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.320579:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909207.320652:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+43:2349:x1875807004836480:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 206us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909207.320660:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00010000:00010000:0.0:1788909207.321432:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5ce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44697 expref: 42 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.321454:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537404380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875807019529344:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909207.321492:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.321502:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.321508:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788909207.321690:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788909207.321945:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788909207.322289:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537404380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875807019529472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788909207.322367:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909207.322408:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82600 going to sleep for 11 seconds 00000100:00100000:2.0:1788909207.322540:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019529472 00000100:00100000:2.0:1788909207.322548:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019529472 00000100:00100000:2.0:1788909207.322624:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788909207.322635:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5825:x1875807019529472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788909207.322732:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5825:x1875807019529472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909207.322740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788909207.322816:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788909207.322890:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537404380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875807019529472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788909207.324677:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788909207.324782:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537404380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875807019529600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788909207.324856:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909207.325098:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82780 going to sleep for 11 seconds 00000100:00100000:2.0:1788909207.325413:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019529600 00000100:00100000:2.0:1788909207.325422:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019529600 00000100:00100000:2.0:1788909207.325523:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788909207.325534:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5825:x1875807019529600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788909207.325815:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5825:x1875807019529600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 282us (958us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788909207.325823:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788909207.325908:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537404380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875807019529600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788909207.326007:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788909207.326067:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.326091:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.326100:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.326128:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ce00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909207.326134:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.326145:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.326174:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890510293f00) 00010000:00010000:1.0:1788909207.326178:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788909207.326184:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.326191:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788909207.326404:0:5825:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788909207.326584:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788909207.326599:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 289400488892ns, next at 290400485699ns, rc = 0 00000001:00080000:1.0:1788909207.326607:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788909207.326648:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890510293f00) 00010000:00010000:1.0:1788909207.326652:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788909207.326659:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5d29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446ba expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909207.326788:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+45:10525:x1875807004836352:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 11467us (11727us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788909207.326797:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000020:00080000:1.0:1788909207.326801:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788909207.331409:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909207.331538:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004836608 00000100:00100000:1.0:1788909207.331550:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004836608 00000100:00100000:1.0:1788909207.331619:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:1.0:1788909207.331632:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+45:10525:x1875807004836608:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788909207.331662:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909207.331688:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5d45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446c1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.331765:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446c1 expref: 46 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.331784:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446c1 expref: 46 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.331808:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:1.0:1788909207.331812:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788909207.331816:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768c00, rc 0) 00000100:00100000:1.0:1788909207.331937:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+46:10525:x1875807004836608:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 308us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909207.331944:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:3.0:1788909207.336368:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.336454:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004836864 00000100:00100000:2.0:1788909207.336477:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004836864 00000100:00100000:2.0:1788909207.336550:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788909207.336562:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+46:10525:x1875807004836864:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909207.336869:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+47:10525:x1875807004836864:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 309us (517us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788909207.336878:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:3.0:1788909207.416572:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.416664:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004836992 00000100:00100000:0.0:1788909207.416689:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004836992 00000100:00100000:0.0:1788909207.416762:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:0.0:1788909207.416772:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+47:10535:x1875807004836992:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1788909207.416882:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.416899:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.416911:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.416928:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.416935:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.416952:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417054:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417063:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417069:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788909207.417138:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417152:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417167:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417188:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417193:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909207.417197:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417204:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417216:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909207.417218:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909207.417223:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417228:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5d4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417241:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417247:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417253:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417258:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ca00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909207.417266:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417272:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417280:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890513293800) 00010000:00010000:0.0:1788909207.417283:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909207.417285:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417290:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5d53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417305:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417310:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417315:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417319:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ce00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909207.417322:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417327:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417333:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909207.417335:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909207.417342:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.417348:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.417431:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+47:10535:x1875807004836992:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 659us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909207.417438:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:3.0:1788909207.471176:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909207.471719:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004837248 00000100:00100000:1.0:1788909207.471735:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004837248 00000100:00100000:1.0:1788909207.471887:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:1.0:1788909207.471899:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+47:10538:x1875807004837248:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788909207.471922:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909207.471944:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d5d61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446c8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472024:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472040:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472050:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472066:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472073:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472079:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472236:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472245:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472253:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909207.472288:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788909207.472391:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472399:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472406:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472412:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909207.472416:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472423:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472435:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:1.0:1788909207.472438:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909207.472443:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472449:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769c00/0x733cfdd8721d5d68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472479:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472486:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472503:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472508:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909207.472511:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472517:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472526:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890520ac5000) 00010000:00010000:1.0:1788909207.472529:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909207.472532:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472538:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472579:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d5d61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446c8 expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472608:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446c8 expref: 49 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.472616:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:1.0:1788909207.472618:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909207.472621:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769000, rc 0) 00000100:00100000:1.0:1788909207.472699:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+49:10538:x1875807004837248:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 802us (1534us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788909207.472716:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 102 00000100:00100000:3.0:1788909207.479782:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.481762:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004837376 00000100:00100000:0.0:1788909207.481775:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004837376 00000100:00100000:0.0:1788909207.481841:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:0.0:1788909207.481851:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+49:10538:x1875807004837376:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1788909207.482260:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.482280:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.482292:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.482319:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.482326:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.482334:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.482339:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ce00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909207.482361:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.482441:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.482456:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909207.482459:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788909207.482473:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.482481:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5d84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.482573:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+49:10538:x1875807004837376:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 721us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909207.482580:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:3.0:1788909207.487048:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.487932:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004837632 00000100:00100000:2.0:1788909207.487945:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004837632 00000100:00100000:2.0:1788909207.488010:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788909207.488037:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+49:10538:x1875807004837632:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909207.488850:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:10538:x1875807004837632:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 812us (1817us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788909207.488859:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:3.0:1788909207.568495:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909207.568663:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004837888 00000100:00100000:1.0:1788909207.568674:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004837888 00000100:00100000:1.0:1788909207.568811:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:1.0:1788909207.568823:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:10548:x1875807004837888:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788909207.568852:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909207.568856:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788909207.568885:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5d06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446ac expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.568907:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:1.0:1788909207.568912:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788909207.568925:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d5d8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446cf expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.569024:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.569038:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446c8 expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.569047:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.569081:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446c8 expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.569094:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446c8 expref: 50 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909207.569189:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890508ff9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019529728:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909207.569287:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909207.574276:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890508ff9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019529728:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788909207.574315:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909207.574816:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.575248:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004838016 00000100:00100000:2.0:1788909207.575258:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004838016 00010000:00010000:2.0:1788909207.575305:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446c8 expref: 51 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909207.575354:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:2.0:1788909207.575376:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+51:2349:x1875807004838016:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909207.575393:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909207.575400:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446c8 expref: 51 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.575415:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446c8 expref: 51 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.575440:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d5d76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446c8 expref: 51 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.575470:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:2.0:1788909207.575475:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.575486:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.575510:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.575589:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909207.575652:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:2349:x1875807004838016:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 277us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909207.575660:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00010000:00010000:1.0:1788909207.577304:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.577322:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909207.577350:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788909207.577604:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d5d8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446cf expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.577625:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446cf expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.577635:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:1.0:1788909207.577638:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788909207.577641:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768000, rc 0) 00000100:00100000:1.0:1788909207.577758:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:10548:x1875807004837888:12345-192.168.204.54@tcp:101:bash.0 Request processed in 8936us (9281us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788909207.577768:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 104 00000100:00100000:3.0:1788909207.586253:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.586374:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004838272 00000100:00100000:2.0:1788909207.586385:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004838272 00000100:00100000:2.0:1788909207.586482:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:2.0:1788909207.586495:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:10548:x1875807004838272:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1788909207.587427:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.587452:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.587475:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788909207.587547:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788909207.587582:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c479963f reply state 000000001aa4ad04 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909207.587591:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788909207.588072:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+53:10548:x1875807004838272:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1572us (1828us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788909207.588084:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000020:00080000:2.0:1788909207.588091:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788909207.592049:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.592083:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.592091:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.592097:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909207.592102:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.592147:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.592166:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:1.0:1788909207.592169:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909207.592174:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.592180:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5da0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909207.595442:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.595603:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004838400 00000100:00100000:2.0:1788909207.595614:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004838400 00000100:00100000:2.0:1788909207.595719:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:2.0:1788909207.595740:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:10548:x1875807004838400:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909207.595764:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909207.595786:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5da7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446d6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.595880:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.595897:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446cf expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.595907:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.595949:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446cf expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.595966:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446cf expref: 53 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909207.595980:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890509379500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019529856:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909207.596070:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905373e2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909207.606278:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.606440:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890509379500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019529856:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909207.606470:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004838528 00000100:00100000:1.0:1788909207.606480:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004838528 00010000:00010000:2.0:1788909207.606497:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.606527:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446cf expref: 54 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909207.606586:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1788909207.606596:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:2350:x1875807004838528:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909207.606613:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909207.606627:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446cf expref: 54 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.606640:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446cf expref: 54 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.606662:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d5d92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446cf expref: 54 pid: 5823 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.606679:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:1.0:1788909207.606684:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.606694:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.606701:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.606729:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909207.606787:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+53:2350:x1875807004838528:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 192us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909207.606794:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00010000:00010000:2.0:1788909207.608239:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.608256:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909207.608312:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788909207.608317:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909207.608341:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.608382:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5da7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446d6 expref: 53 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.608401:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446d6 expref: 52 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.608411:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:2.0:1788909207.608414:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909207.608417:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10200, rc 0) 00000100:00100000:2.0:1788909207.608527:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:10548:x1875807004838400:12345-192.168.204.54@tcp:101:bash.0 Request processed in 12789us (13099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909207.608537:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:0.0:1788909207.619026:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909207.619429:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004838784 00000100:00100000:1.0:1788909207.619445:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004838784 00000100:00100000:1.0:1788909207.620095:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1788909207.620150:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:10548:x1875807004838784:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:1.0:1788909207.620595:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+53:10548:x1875807004838784:12345-192.168.204.54@tcp:35:bash.0 Request processed in 483us (1583us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788909207.620642:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1788909207.685352:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890508ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019529984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909207.685427:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909207.685495:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019529984 00000100:00100000:1.0:1788909207.685505:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019529984 00000100:00100000:1.0:1788909207.685562:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788909207.685573:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3286:x1875807019529984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909207.685616:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909207.685667:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3286:x1875807019529984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909207.685675:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788909207.686214:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890508ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019529984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909207.686743:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019530112:0@lo:400:kworker.0 00000100:00100000:0.0:1788909207.686749:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019530496:0@lo:400:kworker.0 00000100:00100000:1.0:1788909207.686793:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909207.686793:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909207.686827:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019530624:0@lo:400:kworker.0 00000100:00100000:0.0:1788909207.686828:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788909207.686833:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019530368:0@lo:400:kworker.0 00000100:00100000:1.0:1788909207.686852:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909207.686865:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019530496 00000100:00100000:0.0:1788909207.686869:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019530496 00000100:00100000:1.0:1788909207.686877:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909207.686883:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019530240:0@lo:400:kworker.0 00000100:00100000:1.0:1788909207.686906:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909207.686913:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788909207.686920:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019530496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909207.686949:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019530112 00000100:00100000:1.0:1788909207.686952:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019530112 00000100:00100000:1.0:1788909207.686985:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788909207.686994:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019530112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909207.687035:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019530112:12345-0@lo:400:kworker.0 Request processed in 43us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909207.687043:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788909207.687094:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019530112:0@lo:400:kworker.0 00000100:00100000:1.0:1788909207.687143:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909207.687192:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019530496:0@lo:400:kworker.0 00000100:00100000:2.0:1788909207.687207:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019530624 00000100:00100000:2.0:1788909207.687213:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019530624 00000100:00080000:2.0:1788909207.687238:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909207.687265:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019530240 00000100:00100000:2.0:1788909207.687269:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019530240 00000100:00100000:2.0:1788909207.687288:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019530368 00000100:00100000:2.0:1788909207.687298:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019530368 00000100:00100000:1.0:1788909207.687302:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788909207.687315:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019530624:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788909207.687319:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909207.687333:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788909207.687343:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019530240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909207.687363:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019530624:12345-0@lo:400:kworker.0 Request processed in 52us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909207.687371:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788909207.687392:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019530240:12345-0@lo:400:kworker.0 Request processed in 50us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909207.687402:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788909207.687417:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019530240:0@lo:400:kworker.0 00000100:00100000:1.0:1788909207.687431:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019530624:0@lo:400:kworker.0 00000100:00100000:2.0:1788909207.687444:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788909207.687454:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019530368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909207.687512:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019530368:12345-0@lo:400:kworker.0 Request processed in 60us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909207.687520:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788909207.687967:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019530368:0@lo:400:kworker.0 00000100:00100000:0.0:1788909207.688054:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019530496:12345-0@lo:400:kworker.0 Request processed in 43us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909207.688064:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788909207.694351:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909207.694548:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004838912 00000100:00100000:2.0:1788909207.694561:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004838912 00000100:00100000:2.0:1788909207.694657:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:2.0:1788909207.694671:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+53:10554:x1875807004838912:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909207.694704:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909207.694739:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5db5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446dd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.694833:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d5dbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.694849:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d5dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.694865:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d5dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909207.695006:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788909207.695012:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909207.695047:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d5dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.695082:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446dd expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.695162:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d5dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446dd expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.695175:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:2.0:1788909207.695180:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909207.695185:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11600, rc 0) 00000100:00100000:2.0:1788909207.695251:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:10554:x1875807004838912:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 585us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909207.695258:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:2.0:1788909207.699203:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909207.700327:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004839040 00000100:00100000:3.0:1788909207.700340:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004839040 00000100:00100000:3.0:1788909207.700393:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:3.0:1788909207.700404:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:10554:x1875807004839040:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909207.700425:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909207.700453:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5dc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446e4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700537:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700552:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700563:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700576:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700583:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700589:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700686:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700695:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700702:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909207.700756:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788909207.700761:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788909207.700781:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700799:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700808:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700814:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700821:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700827:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909207.700831:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700842:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700860:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:3.0:1788909207.700865:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909207.700872:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700880:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5dca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700899:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700907:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700930:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700938:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909207.700944:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.700953:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.701079:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890507e13e00) 00010000:00010000:3.0:1788909207.701082:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909207.701086:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.701091:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5dd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.701172:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5dc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.701186:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.701194:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:3.0:1788909207.701196:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788909207.701199:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9a00, rc 0) 00000100:00100000:3.0:1788909207.701258:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:10554:x1875807004839040:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 856us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909207.701286:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:0.0:1788909207.709834:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.709947:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.710014:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004839424 00000100:00100000:0.0:1788909207.710026:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004839424 00000100:00100000:0.0:1788909207.710090:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:0.0:1788909207.710099:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:10554:x1875807004839424:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909207.710143:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909207.710181:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446eb expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.710295:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.710320:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446d6 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.710332:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.710343:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.710428:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.710476:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 56 pid: 5822 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.711173:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f68700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019530752:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909207.711287:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446d6 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.711298:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446d6 expref: 56 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.711309:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019530880:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909207.711335:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909207.716494:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004839168 00000100:00100000:3.0:1788909207.716591:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004839168 00010000:00010000:3.0:1788909207.716675:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 57 pid: 5822 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909207.716786:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:3.0:1788909207.716799:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:2348:x1875807004839168:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909207.716816:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909207.716824:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 57 pid: 5822 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.716839:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 57 pid: 5822 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.716867:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:3.0:1788909207.717069:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.717083:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909207.717091:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909207.717699:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:2348:x1875807004839168:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 900us (7872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909207.717707:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:0.0:1788909207.722329:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:0.0:1788909207.723181:0:7640:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.54@tcp) returned -22 from blocking AST (req@00000000e7586e78 x1875807019530752) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 56 pid: 5822 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.723215:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5dd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446e4 expref: 56 pid: 5822 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909207.723237:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f68700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019530752:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909207.723252:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019530880:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909207.723273:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909207.723279:0:7640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.723296:0:7640:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.723305:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909207.726139:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004839552 00000100:00100000:1.0:1788909207.726156:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004839552 00010000:00010000:1.0:1788909207.726202:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446d6 expref: 56 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909207.726320:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:1.0:1788909207.726330:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:2349:x1875807004839552:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909207.726347:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909207.726354:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446d6 expref: 56 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.726368:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446d6 expref: 56 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.726393:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446d6 expref: 56 pid: 5824 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.726409:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:1.0:1788909207.726422:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.726432:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.726439:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.726481:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909207.726518:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.726526:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909207.726544:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:2349:x1875807004839552:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 216us (4228us total) trans 0 rc 0/0 00000004:00200000:2.0:1788909207.726545:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:1.0:1788909207.726552:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00010000:00010000:2.0:1788909207.726698:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446eb expref: 56 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.726726:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446eb expref: 55 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909207.726736:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:2.0:1788909207.726739:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788909207.726742:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9c400, rc 0) 00000100:00100000:2.0:1788909207.726784:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:10554:x1875807004839424:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 16686us (16840us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788909207.726793:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:0.0:1788909207.729522:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909207.729857:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004839808 00000100:00100000:1.0:1788909207.729868:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004839808 00000100:00100000:1.0:1788909207.729933:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788909207.729942:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:10554:x1875807004839808:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:1.0:1788909207.729958:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909207.730292:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d5d45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446c1 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909207.730310:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:1.0:1788909207.730315:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909207.730370:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:10554:x1875807004839808:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 429us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909207.730378:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788909207.733963:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.733998:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004839936 00000100:00100000:0.0:1788909207.734007:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004839936 00000100:00100000:0.0:1788909207.734062:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:0.0:1788909207.734072:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:10554:x1875807004839936:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:0.0:1788909207.734207:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.734228:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.734239:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788909207.734444:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788909207.735016:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:10554:x1875807004839936:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 943us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909207.735026:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 00000001:00080000:1.0:1788909207.737777:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1788909207.737800:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1788909207.737806:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788909207.737823:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1788909207.740896:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909207.741047:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004840064 00000100:00100000:0.0:1788909207.741065:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004840064 00000100:00100000:0.0:1788909207.741212:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 111 00000100:00100000:0.0:1788909207.741222:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:10554:x1875807004840064:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909207.741261:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909207.741283:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5dfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446f2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.741348:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.741363:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5dfb lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f2 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.741394:0:5823:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.741415:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5dfb lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f2 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.741437:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909207.741442:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909207.741450:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5dfb lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f2 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909207.741475:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d200, rc 0) 00000100:00100000:1.0:1788909207.741898:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:10554:x1875807004840064:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 675us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909207.741907:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 111 00000040:00080000:2.0:1788909208.069733:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909208.069746:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909208.069805:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788909208.069812:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788909208.069940:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905379a0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019531008:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788909208.070240:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff89051053e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788909208.076046:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.077643:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004840192 00000100:00100000:0.0:1788909208.077659:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004840192 00000100:00100000:0.0:1788909208.077770:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00100000:0.0:1788909208.077783:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:10555:x1875807004840192:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788909208.077838:0:5824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788909208.077957:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:10555:x1875807004840192:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 178us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.077980:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 112 00000100:00080000:1.0:1788909208.080406:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909208.081769:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.081852:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004840320 00000100:00100000:0.0:1788909208.081864:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004840320 00000100:00100000:0.0:1788909208.082166:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:0.0:1788909208.082177:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:10555:x1875807004840320:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788909208.082281:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082303:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082320:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909208.082337:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905379a0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019531008:192.168.204.54@tcp:107:hsm_cdtr.0 00010000:00010000:0.0:1788909208.082406:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082415:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082423:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082465:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082473:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082480:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909208.082557:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788909208.082563:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909208.082578:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082589:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082595:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082602:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082609:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ce00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.082614:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082622:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082636:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:0.0:1788909208.082638:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909208.082644:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082650:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082665:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082679:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082685:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082689:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ca00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.082692:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082698:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082705:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff890513293800) 00010000:00010000:0.0:1788909208.082708:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909208.082710:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082715:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082732:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082737:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082741:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082745:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.082754:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082759:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082766:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909208.082768:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909208.082771:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.082775:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.082863:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:10555:x1875807004840320:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 687us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.082871:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 113 00000100:00100000:0.0:1788909208.094150:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909208.094203:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004840576 00000100:00100000:2.0:1788909208.094213:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004840576 00000100:00100000:2.0:1788909208.094273:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:2.0:1788909208.094284:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:10555:x1875807004840576:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788909208.094305:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909208.094325:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5e17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a446f9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094428:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094467:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094481:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909208.094496:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788909208.094598:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094606:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094613:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094627:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909208.094632:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094639:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094652:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:2.0:1788909208.094655:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788909208.094660:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094666:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094708:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5e17 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f9 expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094725:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:2.0:1788909208.094728:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909208.094732:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d5e17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f9 expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.094741:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11c00, rc 0) 00000100:00100000:2.0:1788909208.094807:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:10555:x1875807004840576:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 525us (668us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788909208.094815:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 114 00000100:00100000:2.0:1788909208.105755:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909208.105969:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004840704 00000100:00100000:1.0:1788909208.105979:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004840704 00000100:00100000:1.0:1788909208.106057:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:1.0:1788909208.106068:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:10555:x1875807004840704:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788909208.106144:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788909208.106370:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:10555:x1875807004840704:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 297us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909208.106379:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 115 00000100:00100000:1.0:1788909208.113090:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909208.113834:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004840960 00000100:00100000:3.0:1788909208.113858:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004840960 00000100:00100000:3.0:1788909208.113947:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:3.0:1788909208.113959:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:10555:x1875807004840960:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788909208.113981:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909208.113984:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788909208.114014:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d5dbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446dd expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.114036:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:3.0:1788909208.114042:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909208.114056:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5e2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44700 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788909208.115075:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788909208.115411:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5e33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.115425:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.115435:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.115499:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5e2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44700 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.115517:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44700 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.115602:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890507e13e00) 00010000:00010000:3.0:1788909208.115604:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788909208.115608:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9200, rc 0) 00000100:00100000:3.0:1788909208.115735:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:10555:x1875807004840960:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1778us (2665us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788909208.115744:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:2.0:1788909208.120714:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.120866:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004841216 00000100:00100000:0.0:1788909208.120888:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004841216 00000100:00100000:0.0:1788909208.122712:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:0.0:1788909208.122739:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:10555:x1875807004841216:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788909208.122807:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909208.122835:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5e33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44700 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.122856:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890507e13e00) 00010000:00010000:0.0:1788909208.122866:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909208.122888:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.122915:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.122925:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.122939:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.122945:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.122950:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123026:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123034:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123040:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123046:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.123051:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123058:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123067:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:0.0:1788909208.123077:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909208.123081:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123087:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123097:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123104:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123127:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123132:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ca00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.123135:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123141:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123149:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc9107d1 (ffff890513293800) 00010000:00010000:0.0:1788909208.123151:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909208.123154:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.123160:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc9107d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.123780:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:10555:x1875807004841216:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1052us (3073us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788909208.123799:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:2.0:1788909208.132405:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.132547:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004841344 00000100:00100000:0.0:1788909208.132563:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004841344 00000100:00100000:0.0:1788909208.132639:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:0.0:1788909208.132650:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:10555:x1875807004841344:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909208.132679:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909208.132723:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44707 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.132764:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.132778:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.132789:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.132908:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44707 expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.132927:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44707 expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.132935:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:0.0:1788909208.132945:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788909208.132949:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d600, rc 0) 00000100:00100000:0.0:1788909208.133014:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:10555:x1875807004841344:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 365us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.133028:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:2.0:1788909208.142832:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909208.142969:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004841600 00000100:00100000:1.0:1788909208.142980:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004841600 00000100:00100000:1.0:1788909208.143467:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:1.0:1788909208.143482:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:10555:x1875807004841600:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788909208.143605:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.143630:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.143644:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788909208.143960:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1788909208.143970:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 290217859597ns, next at 291217857482ns, rc = 0 00000004:00010000:1.0:1788909208.145851:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd78b670 reply state 000000007193dba3 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909208.145869:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788909208.146014:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:10555:x1875807004841600:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2531us (3186us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788909208.146023:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:2.0:1788909208.151310:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.151394:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004841728 00000100:00100000:0.0:1788909208.151407:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004841728 00000100:00100000:0.0:1788909208.151544:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:0.0:1788909208.151558:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:10555:x1875807004841728:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909208.151596:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909208.151623:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4470e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.151691:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4470e expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.151704:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4470e expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.151725:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:0.0:1788909208.151727:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909208.151731:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ca00, rc 0) 00000100:00100000:0.0:1788909208.151789:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:10555:x1875807004841728:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 235us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.151803:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00010000:00010000:1.0:1788909208.151883:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.151893:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.151900:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.151906:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909208.151912:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.151919:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.151931:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:1.0:1788909208.151934:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788909208.151938:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.151956:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d5e5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.154701:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909208.154899:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004841856 00000100:00100000:2.0:1788909208.154913:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004841856 00000100:00100000:2.0:1788909208.155003:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1788909208.155014:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004841856:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788909208.155273:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788909208.155966:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2350:x1875807004841856:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 950us (1272us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788909208.155976:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1788909208.160049:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.160335:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004842112 00000100:00100000:0.0:1788909208.160345:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004842112 00000100:00100000:0.0:1788909208.160519:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788909208.160531:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:10555:x1875807004842112:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788909208.160824:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:10555:x1875807004842112:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 288us (776us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788909208.160847:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788909208.164426:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909208.164555:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004842368 00000100:00100000:2.0:1788909208.164567:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004842368 00000100:00100000:2.0:1788909208.164707:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1788909208.164743:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:10555:x1875807004842368:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788909208.164882:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:10555:x1875807004842368:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 146us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909208.164890:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:3.0:1788909208.172556:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.172808:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004842496 00000100:00100000:0.0:1788909208.172821:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004842496 00000100:00100000:0.0:1788909208.173353:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:0.0:1788909208.173366:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:10555:x1875807004842496:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909208.173392:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909208.173417:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5e6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44715 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.173524:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.173540:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.173556:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909208.173602:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909208.173623:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.173654:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d400/0x733cfdd8721d5e6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44715 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.173673:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44715 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.173706:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:0.0:1788909208.173710:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788909208.173714:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9ce00, rc 0) 00000100:00100000:0.0:1788909208.173788:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:10555:x1875807004842496:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 424us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.173795:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:1.0:1788909208.178924:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909208.179031:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004842624 00000100:00100000:3.0:1788909208.179042:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004842624 00000100:00100000:3.0:1788909208.179252:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1788909208.179265:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2350:x1875807004842624:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788909208.179286:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909208.179310:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4471c expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909208.179345:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa09697, blocks: 0x1 00010000:00010000:3.0:1788909208.179366:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=290s v=(0 0) 00010000:00010000:3.0:1788909208.179372:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909208.179383:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4471c expref: 10 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.179403:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4471c expref: 10 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.179438:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9600, rc 0) 00000100:00100000:3.0:1788909208.179519:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:2350:x1875807004842624:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 256us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909208.179526:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1788909208.181894:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909208.181992:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004842880 00000100:00100000:3.0:1788909208.182004:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004842880 00000100:00100000:3.0:1788909208.182160:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:3.0:1788909208.182173:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:10555:x1875807004842880:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788909208.182304:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:10555:x1875807004842880:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 133us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909208.182312:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:2.0:1788909208.186327:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.186424:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004843008 00000100:00100000:0.0:1788909208.186437:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004843008 00000100:00100000:0.0:1788909208.186540:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1788909208.186549:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:10555:x1875807004843008:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909208.186566:0:8092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909208.186587:0:8092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44723 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.186620:0:8092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4471c expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.186628:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909208.186633:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909208.186637:0:8092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 11 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.186677:0:8092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4471c expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.186718:0:8092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4471c expref: 11 pid: 6673 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.186736:0:8092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8092:1875807019531136:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909208.186942:0:8092:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82480 going to sleep for 11 seconds 00000100:00100000:0.0:1788909208.189671:0:8092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8092:1875807019531136:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909208.189720:0:8092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 11 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.189745:0:8092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890504d9d400, rc 0) 00000100:00100000:0.0:1788909208.189813:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:10555:x1875807004843008:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3263us (3499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.189822:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788909208.192492:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909208.192594:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004843136 00000100:00100000:3.0:1788909208.192607:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004843136 00010000:00010000:3.0:1788909208.192732:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4471c expref: 11 pid: 6673 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.192820:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1788909208.192831:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:2349:x1875807004843136:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909208.192846:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909208.192871:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4471c expref: 11 pid: 6673 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.192886:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4471c expref: 11 pid: 6673 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.192934:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5e79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4471c expref: 11 pid: 6673 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.192954:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909208.192958:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909208.192968:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 10 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.192978:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 10 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.193021:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 10 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.193039:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1875807019531264:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788909208.193195:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909208.198835:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1875807019531264:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788909208.198869:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909208.198990:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:2349:x1875807004843136:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 6158us (6510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909208.199001:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1788909208.200829:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909208.200919:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004843264 00000100:00100000:1.0:1788909208.200932:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004843264 00002000:00100000:1.0:1788909208.201001:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff89053cbf2680 x1875807004843264/t0(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:139/0 lens 504/0 e 0 to 0 dl 1788909219 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788909208.201013:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89053cbf2680 with x1875807004843264 ext(0->12) 00002000:00010000:1.0:1788909208.201020:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89053cbf2680 00000100:00100000:1.0:1788909208.201271:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1788909208.201285:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:2349:x1875807004843264:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788909208.201877:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:2349:x1875807004843264:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 593us (1054us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788909208.201886:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:1.0:1788909208.201895:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff89053cbf2680 x1875807004843264/t4294967308(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:139/0 lens 504/448 e 0 to 0 dl 1788909219 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788909208.201904:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89053cbf2680 with x1875807004843264 ext(0->12) 00002000:00010000:1.0:1788909208.201909:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89053cbf2680 00000100:00100000:1.0:1788909208.206513:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.206641:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004843392 00000100:00100000:0.0:1788909208.206654:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004843392 00000100:00100000:0.0:1788909208.206734:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:0.0:1788909208.206747:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:10555:x1875807004843392:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788909208.248966:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1788909208.248999:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890531d82600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788909208.249005:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89052d445f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890531d82a80 00000020:00080000:2.0:1788909208.249009:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89052d445500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89052d69d800 00000004:00080000:2.0:1788909208.249048:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788909208.249056:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788909208.249674:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788909208.249699:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019531392:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788909208.249785:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909208.249859:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019531392 00000100:00100000:0.0:1788909208.249868:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019531392 00000100:00100000:0.0:1788909208.249946:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788909208.249956:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019531392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788909208.250009:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788909208.250083:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.250139:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44682 expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.250160:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788909208.250166:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909208.250171:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.250205:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44682 expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.250221:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44682 expref: 11 pid: 6676 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.250234:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6676:1875807019531520:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909208.250298:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82480 going to sleep for 11 seconds 00000100:00080000:0.0:1788909208.250317:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788909208.250688:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788909208.250722:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788909208.250804:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8905373e2840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788909208.250818:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890537acb400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8905373e2000 00000020:00080000:2.0:1788909208.250821:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890537acbe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89052dc3f800 00000100:00100000:0.0:1788909208.251695:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019531648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788909208.251749:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909208.251805:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019531648 00000100:00100000:1.0:1788909208.252345:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:10555:x1875807004843392:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 45598us (45845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909208.252374:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:0.0:1788909208.252404:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019531648 00000100:00100000:0.0:1788909208.252470:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788909208.252490:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3285:x1875807019531648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788909208.252697:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788909208.252702:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788909207 00002000:00010000:0.0:1788909208.252705:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788909208.252706:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788909207 -> 1788909207 00002000:00010000:0.0:1788909208.252708:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788909208.252759:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3285:x1875807019531648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 272us (1009us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788909208.252766:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1788909208.253100:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890537f6b100/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788909208.253145:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019531648:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1788909208.253613:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788909208.253801:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788909208.253914:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019531776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788909208.253970:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909208.254028:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019531776 00000100:00100000:0.0:1788909208.254034:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019531776 00000100:00100000:0.0:1788909208.254071:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788909208.254080:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019531776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788909208.254105:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788909208.254240:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa09696, atime: 0x6aa09696, ctime: 0x6aa09696, blocks: 0xb 00010000:00010000:0.0:1788909208.254249:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.254272:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=290s v=(0 0) 00010000:00010000:0.0:1788909208.254277:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909208.254284:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.254303:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.254328:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.254336:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.254358:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788909208.255407:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019531776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1323us (1432us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788909208.255418:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788909208.255469:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909208.255475:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.255486:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909208.255491:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.255501:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.255521:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.255528:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4f33d51/0x733cfdd8721d5e8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.255559:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909208.255561:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909208.255563:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909208.255939:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6676:1875807019531520:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909208.255963:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909208.256075:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909208.256230:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004843520 00000100:00100000:3.0:1788909208.256238:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004843520 00010000:00010000:3.0:1788909208.256267:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44682 expref: 12 pid: 6676 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.256305:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788909208.256315:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:2350:x1875807004843520:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909208.256330:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909208.256337:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44682 expref: 12 pid: 6676 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.256351:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44682 expref: 12 pid: 6676 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.256371:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028e59c5a/0x733cfdd8721d5c49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44682 expref: 12 pid: 6676 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.256386:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788909208.256391:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788909208.256397:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.256426:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.256471:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909208.256522:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:2350:x1875807004843520:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 208us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909208.256529:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00010000:00010000:2.0:1788909208.256649:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.256657:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.256668:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.256688:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.256711:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788909208.256911:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909208.256918:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.256927:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516c00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909208.256931:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.256940:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.256956:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.256963:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fedceba/0x733cfdd8721d5e87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.256985:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909208.256987:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909208.256989:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909208.257727:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3283:x1875807019531392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7771us (7939us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788909208.257739:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788909208.258462:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788909208.258469:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:1.0:1788909208.258490:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8905379a2a00, transno 4294967301 00000004:00080000:1.0:1788909208.258506:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1788909208.258522:0:3286:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff89053cb91180 x1875807019531776/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788909224 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788909208.258535:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89053cb91180/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788909208.258541:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019531776:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788909208.260388:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890537f69180/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788909208.260409:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019531392:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788909208.262379:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909208.262890:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909208.263091:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004843648 00000100:00100000:2.0:1788909208.263104:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004843648 00000100:00100000:2.0:1788909208.263231:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1788909208.263243:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:2350:x1875807004843648:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788909208.307193:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788909208.307223:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1788909208.307243:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1788909208.307861:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004843648:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 44609us (44967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.307886:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1788909208.316678:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909208.317604:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004843904 00000100:00100000:2.0:1788909208.317621:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004843904 00000100:00100000:2.0:1788909208.317706:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:2.0:1788909208.317720:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:10555:x1875807004843904:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788909208.317923:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909208.318073:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ce00/0x733cfdd8721d5e72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44715 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.318102:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:2.0:1788909208.318147:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909208.318192:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.318209:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.318239:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909208.318682:0:7640:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000161f7b reply state 00000000769ab9d9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909208.318693:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788909208.319229:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:10555:x1875807004843904:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1394us (2446us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788909208.319432:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00010000:00010000:1.0:1788909208.322050:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.322072:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.322081:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.322088:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909208.322094:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.322103:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.325469:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:1.0:1788909208.325474:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909208.325485:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.325492:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d5e95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.326285:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.326560:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004844032 00000100:00100000:0.0:1788909208.326576:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004844032 00000100:00100000:0.0:1788909208.326650:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:0.0:1788909208.326662:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004844032:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788909208.327149:0:8092:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788909208.327153:0:8092:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788909207 -> 1788909206 00002000:00010000:0.0:1788909208.327156:0:8092:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788909206 00002000:00010000:0.0:1788909208.327158:0:8092:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788909207 -> 1788909206 00002000:00010000:0.0:1788909208.327160:0:8092:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788909208.327254:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004844032:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 593us (973us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788909208.327350:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788909208.330638:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.330973:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004844288 00000100:00100000:0.0:1788909208.330990:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004844288 00000100:00100000:0.0:1788909208.331248:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:0.0:1788909208.331262:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:10555:x1875807004844288:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788909208.331363:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.331388:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44707 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.331398:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.331484:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44707 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.331501:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44707 expref: 15 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.331519:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019531904:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909208.331657:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788909208.335759:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019531904:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909208.335799:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909208.335885:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909208.336220:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004844416 00000100:00100000:2.0:1788909208.336230:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004844416 00010000:00010000:2.0:1788909208.336280:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44707 expref: 16 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909208.336392:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:2.0:1788909208.336404:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:2349:x1875807004844416:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909208.336425:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909208.336435:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44707 expref: 16 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.336458:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44707 expref: 16 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.336488:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d600/0x733cfdd8721d5e56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44707 expref: 16 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.336533:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:2.0:1788909208.336537:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.336548:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.336556:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909208.336592:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909208.336741:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.336749:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.336794:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.336802:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.336810:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.336817:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.336823:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.336846:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.336856:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:0.0:1788909208.336860:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788909208.336866:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.336872:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5e9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909208.336948:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:2349:x1875807004844416:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 545us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909208.336957:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1788909208.337506:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10555:x1875807004844288:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 6247us (6883us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788909208.337516:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:3.0:1788909208.345668:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.345866:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004844544 00000100:00100000:0.0:1788909208.345877:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004844544 00000100:00100000:0.0:1788909208.345960:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:0.0:1788909208.345973:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2347:x1875807004844544:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788909208.346503:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.346534:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 7 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.346543:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909208.346548:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909208.346552:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.346603:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 7 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.346617:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 7 pid: 8092 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.346632:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1875807019532032:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909208.346897:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788909208.353067:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.353153:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1875807019532032:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909208.353200:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.353487:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004844672 00000100:00100000:3.0:1788909208.353497:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004844672 00010000:00010000:3.0:1788909208.353546:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 8 pid: 8092 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.353590:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1788909208.353602:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004844672:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909208.353620:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909208.353656:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 8 pid: 8092 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.353670:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 8 pid: 8092 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.353782:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092a993ac/0x733cfdd8721d5e80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44723 expref: 8 pid: 8092 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.353801:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788909208.353806:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788909208.353814:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.353825:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.353858:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909208.354032:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004844672:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 430us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909208.354039:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00010000:00010000:1.0:1788909208.354555:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.354567:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.354602:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.354610:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.354620:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.354627:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909208.354633:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.354659:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.354676:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.354684:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078efbe5e/0x733cfdd8721d5ea3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909208.354751:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004844544:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 8781us (9097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909208.354759:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788909208.360855:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909208.360976:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004844928 00000100:00100000:1.0:1788909208.360990:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004844928 00000100:00100000:1.0:1788909208.361077:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:1.0:1788909208.361090:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10555:x1875807004844928:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788909208.361237:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.361458:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.361478:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.361771:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.361803:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4470e expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.361811:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.361859:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4470e expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.361874:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4470e expref: 15 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909208.361891:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019532160:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909208.362013:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788909208.365769:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019532160:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788909208.365801:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.366409:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909208.366967:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004845056 00000100:00100000:2.0:1788909208.366977:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004845056 00010000:00010000:0.0:1788909208.367753:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4470e expref: 16 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.367807:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1788909208.367821:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:2350:x1875807004845056:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909208.367839:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909208.367846:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4470e expref: 16 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.367859:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4470e expref: 16 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.367908:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9ca00/0x733cfdd8721d5e64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4470e expref: 16 pid: 5824 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.367926:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:0.0:1788909208.367931:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.368045:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.368054:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.368092:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909208.368224:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:2350:x1875807004845056:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 407us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.368234:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00010000:00010000:1.0:1788909208.368574:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.368584:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788909208.368825:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788909208.369010:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788909208.369056:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788909208.369200:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875807019532288:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788909208.369284:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909208.369324:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788909208.369692:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019532288 00000100:00100000:0.0:1788909208.369704:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019532288 00000100:00100000:0.0:1788909208.369757:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788909208.369768:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1875807019532288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788909208.370493:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1875807019532288:12345-0@lo:1000:mdt00_001.0 Request processed in 725us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.370502:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788909208.370590:0:5823:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788909208.370596:0:5823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1788909208.370619:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890537f6b100, transno 4294967309 00000004:00080000:1.0:1788909208.370925:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890537f69180, transno 4294967310 00000100:00100000:1.0:1788909208.371861:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875807019532288:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788909208.374838:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788909208.378070:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f6b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875807019532416:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788909208.378294:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909208.378503:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788909208.378567:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019532416 00000100:00100000:1.0:1788909208.378579:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019532416 00000100:00100000:1.0:1788909208.378703:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788909208.378714:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1875807019532416:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788909208.379054:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5823:x1875807019532416:12345-0@lo:1000:mdt00_001.0 Request processed in 341us (760us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788909208.379063:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788909208.379181:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f6b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875807019532416:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788909208.379253:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379274:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379283:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379290:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.379296:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379306:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379328:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890513293800) 00010000:00010000:0.0:1788909208.379332:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909208.379340:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379346:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5eb1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379388:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379406:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379412:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379431:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9da00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.379434:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379441:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379460:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909208.379463:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909208.379470:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5dfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379484:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5dfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379494:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5dfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.379538:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5dfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.379553:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019532544:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788909208.379646:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909208.383426:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909208.383591:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004845184 00000100:00100000:1.0:1788909208.383604:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004845184 00000100:00100000:1.0:1788909208.383673:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1788909208.383685:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10554:x1875807004845184:12345-192.168.204.54@tcp:49:lfs.0 00000100:00100000:1.0:1788909208.383866:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:10554:x1875807004845184:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 182us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909208.383876:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1788909208.384085:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019532544:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788909208.384274:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384313:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9da00/0x733cfdd8721d5df4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384361:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384381:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384689:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384705:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384711:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384717:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384724:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.384728:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384735:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384748:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909208.384752:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909208.384756:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384769:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5eb8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384779:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384785:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384790:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384795:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909208.384798:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384803:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384811:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909208.384813:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788909208.384816:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.384820:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d5eaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.385200:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:10555:x1875807004844928:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 24110us (24360us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788909208.385211:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000020:00080000:0.0:1788909208.385227:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788909208.385642:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909208.385647:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909208.387478:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788909208.387497:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788909208.388774:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909208.389241:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004845440 00000100:00100000:1.0:1788909208.389255:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004845440 00000100:00100000:1.0:1788909208.389336:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:1.0:1788909208.389347:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:10555:x1875807004845440:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788909208.390289:0:5825:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788909208.390456:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788909208.390519:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.390543:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.390559:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.390569:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.390576:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.390582:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909208.390621:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788909208.390776:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:10555:x1875807004845440:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1425us (2010us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788909208.390788:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000020:00080000:1.0:1788909208.390794:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788909208.391030:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909208.391038:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.391046:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769a00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909208.391051:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.391075:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.391092:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff890520ac5200) 00010000:00010000:3.0:1788909208.391095:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788909208.391103:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.391153:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d5ebf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.391172:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909208.391174:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909208.391176:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909208.391977:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909208.392105:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004845696 00000100:00100000:1.0:1788909208.392162:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004845696 00000100:00100000:1.0:1788909208.392305:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:1.0:1788909208.392318:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:10554:x1875807004845696:12345-192.168.204.54@tcp:58:lfs.0 00000040:00080000:1.0:1788909208.392697:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788909208.392881:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:10554:x1875807004845696:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 565us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909208.392906:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1788909208.438956:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909208.439088:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004845824 00000100:00100000:2.0:1788909208.439100:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004845824 00000100:00100000:2.0:1788909208.439294:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:3.0:1788909208.439374:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:10557:x1875807004845824:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909208.439488:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909208.439517:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5ec6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4472a expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.439609:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.439631:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.439646:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.439694:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.439704:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.439711:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.440338:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.440354:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446eb expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.440363:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.440424:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446eb expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.440456:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446eb expref: 21 pid: 7640 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.440476:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019532672:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909208.440638:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788909208.444820:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019532672:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909208.444870:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909208.447779:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909208.447890:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004846080 00000100:00100000:1.0:1788909208.447902:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004846080 00000100:00100000:1.0:1788909208.447965:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1788909208.447976:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:5589:x1875807004846080:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788909208.448282:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:5589:x1875807004846080:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 308us (515us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788909208.448292:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788909208.451355:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909208.451560:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004846208 00000100:00100000:0.0:1788909208.451577:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004846208 00010000:00010000:0.0:1788909208.451644:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446eb expref: 23 pid: 7640 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909208.451722:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1788909208.451740:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:2349:x1875807004846208:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909208.451758:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909208.451765:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446eb expref: 23 pid: 7640 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.451782:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446eb expref: 23 pid: 7640 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.451838:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9c400/0x733cfdd8721d5de6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a446eb expref: 23 pid: 7640 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.451869:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909208.451880:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.451899:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.451942:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909208.451984:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909208.452088:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:2349:x1875807004846208:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 352us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909208.452100:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00010000:00010000:3.0:1788909208.452753:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.452773:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909208.452834:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788909208.452841:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788909208.452873:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.452895:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.452909:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.452918:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.452926:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.452934:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909208.452941:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.452951:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.452966:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:3.0:1788909208.452970:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909208.452976:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453003:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5ecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453027:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453035:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453042:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453049:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909208.453054:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453062:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453076:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff890507e13200) 00010000:00010000:3.0:1788909208.453080:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909208.453084:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453093:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5ed4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453227:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5ec6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4472a expref: 22 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453251:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4472a expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909208.453279:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:3.0:1788909208.453284:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788909208.453288:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9a00, rc 0) 00000100:00100000:3.0:1788909208.453370:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10557:x1875807004845824:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 14061us (14421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909208.453384:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000040:00080000:1.0:1788909209.085074:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788909209.085090:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788909209.085185:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788909209.085194:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788909209.285361:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788909209.413534:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909209.413549:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909209.413599:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788909209.413606:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788909209.413739:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019532800:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788909209.413883:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506a5da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788909209.415907:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019532800:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788909209.416925:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909209.416991:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004846336 00000100:00100000:0.0:1788909209.417000:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004846336 00000100:00100000:0.0:1788909209.417072:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:0.0:1788909209.417086:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10570:x1875807004846336:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788909209.417177:0:5824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788909209.417319:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10570:x1875807004846336:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 235us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909209.417327:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:3.0:1788909209.420681:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909209.420713:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004846592 00000100:00100000:0.0:1788909209.420725:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004846592 00000100:00100000:0.0:1788909209.420788:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:0.0:1788909209.420799:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:10570:x1875807004846592:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909209.420823:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909209.420845:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ee2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44731 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.420952:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5ee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.420967:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.420996:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909209.421010:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788909209.421209:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ee2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44731 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.421228:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44731 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.421237:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909209.421240:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909209.421244:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517400, rc 0) 00000100:00100000:0.0:1788909209.421318:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:10570:x1875807004846592:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 521us (656us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788909209.421330:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:3.0:1788909209.429599:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909209.429667:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909209.429783:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004846720 00000100:00100000:1.0:1788909209.429794:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004846720 00000100:00100000:1.0:1788909209.429945:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1788909209.429956:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:2350:x1875807004846720:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909209.429972:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909209.429999:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5ee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44731 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909209.430020:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:1.0:1788909209.430024:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909209.430085:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:2350:x1875807004846720:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 131us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909209.430157:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788909209.434448:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004846976 00000100:00100000:0.0:1788909209.434479:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004846976 00000100:00100000:0.0:1788909209.434570:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 132 00000100:00100000:0.0:1788909209.434582:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:10570:x1875807004846976:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788909209.434689:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.434710:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.434723:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.434943:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.434951:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.434959:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.434965:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909209.434970:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.434977:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.434991:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909209.434994:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788909209.435000:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909209.435005:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5ef7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909209.435455:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:10570:x1875807004846976:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 874us (5785us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788909209.435466:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 132 00000040:00080000:2.0:1788909209.436226:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909209.436232:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909209.437535:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788909209.437614:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788909209.442529:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909209.443015:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004847232 00000100:00100000:0.0:1788909209.443028:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004847232 00000100:00100000:0.0:1788909209.443239:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1788909209.443264:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:10570:x1875807004847232:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788909209.445029:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:10570:x1875807004847232:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 1751us (2497us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788909209.445045:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00010000:00010000:0.0:1788909210.309670:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788909210.772711:0:12155:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788909210.772723:0:12155:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788909210.773498:0:12155:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788909210.773507:0:12155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788909210.934376:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909210.934485:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004847488 00000100:00100000:3.0:1788909210.934499:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004847488 00000100:00100000:3.0:1788909210.934577:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:3.0:1788909210.934590:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:10590:x1875807004847488:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909210.934622:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909210.934648:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5efe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44738 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909210.934775:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5f05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909210.934794:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5f05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909210.934812:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5f05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909210.934827:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788909210.935181:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9600/0x733cfdd8721d5efe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44738 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909210.935207:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5f05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44738 expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909210.935216:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:3.0:1788909210.935219:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788909210.935223:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9200, rc 0) 00000100:00100000:3.0:1788909210.935338:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:10590:x1875807004847488:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 750us (974us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788909210.935346:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00080000:3.0:1788909210.935374:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909210.937957:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909210.938082:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004847616 00000100:00100000:0.0:1788909210.938100:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004847616 00000100:00100000:0.0:1788909210.938285:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:0.0:1788909210.938314:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:10590:x1875807004847616:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1788909210.938469:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909210.938492:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909210.938506:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909210.938586:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909210.938595:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909210.938603:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909210.938610:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909210.938617:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909210.938642:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909210.938658:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:0.0:1788909210.938680:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788909210.938687:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909210.938704:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d5f13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909210.938864:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:10590:x1875807004847616:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 557us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909210.938873:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:0.0:1788909211.006568:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909211.007260:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004847744 00000100:00100000:3.0:1788909211.007278:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004847744 00000100:00080000:0.0:1788909211.007419:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909211.007438:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1788909211.007462:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004847744:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:3.0:1788909211.007491:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909211.007523:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5f1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4473f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909211.007568:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa09696, atime: 0x6aa09696, ctime: 0x6aa09696, blocks: 0xb 00010000:00010000:3.0:1788909211.007602:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=293s v=(0 0) 00010000:00010000:3.0:1788909211.007611:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909211.007631:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5f1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4473f expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909211.007707:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5f1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4473f expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909211.007731:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9600, rc 0) 00000100:00100000:3.0:1788909211.007840:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004847744:12345-192.168.204.54@tcp:101:cat.0 Request processed in 385us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909211.007851:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788909211.020205:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909211.020342:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004847872 00000100:00100000:3.0:1788909211.020354:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004847872 00002000:00100000:3.0:1788909211.020420:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff890537f69500 x1875807004847872/t0(0) o3->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:142/0 lens 488/0 e 0 to 0 dl 1788909222 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788909211.020433:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff890537f69500 with x1875807004847872 ext(0->4095) 00002000:00010000:3.0:1788909211.020439:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890537f69500 00000100:00100000:3.0:1788909211.020475:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788909211.020486:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004847872:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:3.0:1788909211.020746:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004847872:12345-192.168.204.54@tcp:3:cat.0 Request processed in 260us (547us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788909211.020754:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00002000:00100000:3.0:1788909211.020761:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff890537f69500 x1875807004847872/t0(0) o3->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:142/0 lens 488/4536 e 0 to 0 dl 1788909222 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788909211.020769:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff890537f69500 with x1875807004847872 ext(0->4095) 00002000:00010000:3.0:1788909211.020772:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890537f69500 00010000:00010000:0.0:1788909211.333437:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909211.739692:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909211.739740:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909211.739780:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909211.739819:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004848256 00000100:00100000:2.0:1788909211.739834:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004848256 00000100:00100000:2.0:1788909211.739924:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:2.0:1788909211.739936:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004848256:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:3.0:1788909211.739984:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909211.740036:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004848256:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 102us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909211.740044:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:0.0:1788909211.740213:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004848000 00000100:00100000:0.0:1788909211.740219:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004848000 00000100:00100000:0.0:1788909211.740268:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 281 00000100:00100000:0.0:1788909211.740277:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004848000:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909211.740310:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004848000:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909211.740318:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 281 00000100:00100000:1.0:1788909211.740634:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004848128 00000100:00100000:1.0:1788909211.740640:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004848128 00000100:00100000:1.0:1788909211.740690:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:1.0:1788909211.740698:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004848128:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909211.740736:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004848128:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909211.740743:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00080000:0.0:1788909211.740853:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909211.781469:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019532928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909211.781563:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909211.781770:0:11699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019532928 00000100:00100000:3.0:1788909211.781780:0:11699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019532928 00000100:00100000:3.0:1788909211.782377:0:11699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788909211.782404:0:11699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019532928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909211.782454:0:11699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788909211.782563:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909211.786153:0:11699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019532928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3739us (4577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909211.786170:0:11699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788909211.788224:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019532928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788909212.357239:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909212.805405:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788909212.805433:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019533056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909212.805512:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909212.805589:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019533056 00000100:00100000:3.0:1788909212.805598:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019533056 00000100:00100000:3.0:1788909212.805662:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788909212.805673:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019533056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788909212.805711:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909212.805756:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019533056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909212.805763:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788909212.805785:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788909212.805838:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019533056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909212.807445:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019533184:0@lo:400:kworker.0 00000100:00100000:3.0:1788909212.807499:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019533440:0@lo:400:kworker.0 00000100:00100000:2.0:1788909212.807513:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019533568:0@lo:400:kworker.0 00000100:00100000:0.0:1788909212.807531:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909212.807553:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909212.807563:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909212.807592:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019533696:0@lo:400:kworker.0 00000100:00100000:3.0:1788909212.807607:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019533440 00000100:00100000:3.0:1788909212.807614:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019533440 00000100:00100000:2.0:1788909212.807625:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019533568 00000100:00100000:0.0:1788909212.807626:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909212.807631:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019533568 00000100:00100000:0.0:1788909212.807658:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788909212.807667:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019533312:0@lo:400:kworker.0 00000100:00100000:3.0:1788909212.807674:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019533696 00000100:00100000:2.0:1788909212.807674:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788909212.807682:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875807019533568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909212.807688:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019533696 00000100:00100000:0.0:1788909212.807697:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909212.807721:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019533312 00000100:00100000:3.0:1788909212.807725:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019533312 00000100:00100000:0.0:1788909212.807737:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788909212.807747:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875807019533568:12345-0@lo:400:kworker.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909212.807751:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019533440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909212.807758:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788909212.807763:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788909212.807771:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019533696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909212.807809:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019533440:12345-0@lo:400:kworker.0 Request processed in 62us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909212.807817:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788909212.807834:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019533696:12345-0@lo:400:kworker.0 Request processed in 66us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909212.807841:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788909212.807846:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019533184 00000100:00100000:3.0:1788909212.807852:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788909212.807852:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019533184 00000100:00100000:0.0:1788909212.807853:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019533312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909212.807855:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019533568:0@lo:400:kworker.0 00000100:00100000:1.0:1788909212.807896:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788909212.807898:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019533312:12345-0@lo:400:kworker.0 Request processed in 49us (201us total) trans 0 rc 0/0 00000100:00080000:2.0:1788909212.807902:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909212.807909:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788909212.807916:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019533312:0@lo:400:kworker.0 00000100:00100000:1.0:1788909212.807921:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019533184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909212.807937:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019533696:0@lo:400:kworker.0 00000100:00100000:2.0:1788909212.807945:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019533440:0@lo:400:kworker.0 00000100:00100000:3.0:1788909212.807971:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019533184:0@lo:400:kworker.0 00000100:00100000:1.0:1788909212.807973:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019533184:12345-0@lo:400:kworker.0 Request processed in 67us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909212.808312:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000001:00080000:1.0:1788909212.836787:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788909213.361990:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788909213.362013:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788909213.369600:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1788909213.369631:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8905346c8240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788909213.369637:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890508fc2200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8905346c8900 00000020:00080000:3.0:1788909213.369641:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890508fc2500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89053741d400 00000001:00080000:3.0:1788909213.369679:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788909213.369686:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788909213.369726:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788909213.369935:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788909213.381266:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909214.407014:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909214.481798:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909214.481962:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004848384 00000100:00100000:3.0:1788909214.483163:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004848384 00000100:00100000:3.0:1788909214.483323:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:3.0:1788909214.483344:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:10235:x1875807004848384:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788909214.483500:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:10235:x1875807004848384:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 159us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909214.483508:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00080000:2.0:1788909214.485807:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909214.489379:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909214.489464:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004848640 00000100:00100000:0.0:1788909214.489477:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004848640 00000100:00100000:0.0:1788909214.489556:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788909214.489568:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:10235:x1875807004848640:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788909214.491770:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:10235:x1875807004848640:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 2195us (2396us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788909214.491784:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788909214.725597:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909214.725724:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004848768 00000100:00100000:2.0:1788909214.725737:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004848768 00000100:00100000:2.0:1788909214.725831:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:2.0:1788909214.725847:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+5:11042:x1875807004848768:12345-192.168.204.54@tcp:101:lsof.0 00010000:00010000:2.0:1788909214.725867:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909214.725888:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5f21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44746 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909214.725958:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909214.725971:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909214.725984:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909214.726279:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788909214.726284:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909214.726406:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909214.726443:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5f21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44746 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909214.726480:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44746 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909214.726491:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:2.0:1788909214.726494:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909214.726499:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10200, rc 0) 00000100:00100000:2.0:1788909214.726596:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae3d4805-3977-4f79-88af-684dce002b2f+6:11042:x1875807004848768:12345-192.168.204.54@tcp:101:lsof.0 Request processed in 755us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909214.726605:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00080000:3.0:1788909214.726699:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788909215.429364:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909216.454053:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909216.861145:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909216.861200:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909216.861280:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004848896 00000100:00100000:3.0:1788909216.861301:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004848896 00000100:00100000:3.0:1788909216.861366:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00100000:3.0:1788909216.861378:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2348:x1875807004848896:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909216.861474:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2348:x1875807004848896:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 98us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909216.861483:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 283 00000100:00100000:3.0:1788909216.863199:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909216.863234:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909216.863260:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909216.863304:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004849280 00000100:00100000:3.0:1788909216.863313:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004849280 00000100:00100000:3.0:1788909216.863376:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004849152 00000100:00100000:3.0:1788909216.863380:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004849152 00000100:00100000:3.0:1788909216.863405:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788909216.863416:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004849280:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909216.863496:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004849280:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 83us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909216.863504:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788909216.863519:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1788909216.863525:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004849152:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909216.863547:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004849152:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 22us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909216.863553:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1788909216.863570:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004849024 00000100:00100000:3.0:1788909216.863584:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004849024 00000100:00100000:3.0:1788909216.863612:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004849408 00000100:00100000:3.0:1788909216.863615:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004849408 00000100:00100000:3.0:1788909216.863633:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1788909216.863640:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2348:x1875807004849024:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909216.863671:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2348:x1875807004849024:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909216.863677:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:3.0:1788909216.863688:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:3.0:1788909216.863694:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae3d4805-3977-4f79-88af-684dce002b2f+6:2347:x1875807004849408:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909216.863714:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae3d4805-3977-4f79-88af-684dce002b2f+6:2347:x1875807004849408:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 21us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909216.863720:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00080000:3.0:1788909216.863735:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788909216.863739:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788909216.863741:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909216.906801:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019533824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909216.906882:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909216.906980:0:11699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019533824 00000100:00100000:1.0:1788909216.906988:0:11699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019533824 00000100:00100000:1.0:1788909216.907048:0:11699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788909216.907058:0:11699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019533824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788909216.907097:0:11699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909216.907164:0:11699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019533824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909216.907172:0:11699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788909216.907212:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788909216.907219:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788909216.907246:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019533824:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788909216.907263:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788909217.125344:0:12355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:13:35 (1788909215) 00010000:00010000:3.0:1788909217.477315:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909217.925511:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788909217.929090:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019534080:0@lo:400:kworker.0 00000100:00100000:0.0:1788909217.929332:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909217.929492:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019533952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909217.929526:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909217.929588:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019533952 00000100:00100000:0.0:1788909217.929596:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019533952 00000100:00100000:0.0:1788909217.929668:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788909217.929678:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019533952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788909217.929730:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788909217.929779:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019533952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909217.929785:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788909217.929831:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788909217.929837:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89053cb91180, transno 4294967304 00000100:00100000:0.0:1788909217.929857:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d56c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019533952:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788909217.930391:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909217.931090:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019534080 00000100:00100000:2.0:1788909217.931100:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019534080 00000100:00100000:1.0:1788909217.931228:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019534464:0@lo:400:kworker.0 00000100:00100000:0.0:1788909217.931278:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019534336:0@lo:400:kworker.0 00000100:00100000:1.0:1788909217.931302:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909217.931365:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019534208:0@lo:400:kworker.0 00000100:00100000:2.0:1788909217.931385:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788909217.931398:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019534080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909217.931702:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909217.931728:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909217.931739:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019534592:0@lo:400:kworker.0 00000100:00100000:0.0:1788909217.931754:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019534336 00000100:00100000:0.0:1788909217.931760:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019534336 00000100:00100000:1.0:1788909217.931774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909217.931804:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019534592 00000100:00100000:0.0:1788909217.931808:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019534592 00000100:00100000:1.0:1788909217.931816:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019534464 00000100:00100000:1.0:1788909217.931822:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019534464 00000100:00100000:0.0:1788909217.931859:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788909217.931869:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788909217.931870:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019534336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909217.931883:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019534464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909217.931924:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019534336:12345-0@lo:400:kworker.0 Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909217.931932:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788909217.931954:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788909217.931961:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019534592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909217.932070:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019534464:12345-0@lo:400:kworker.0 Request processed in 191us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909217.932082:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788909217.932146:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019534464:0@lo:400:kworker.0 00000100:00080000:1.0:1788909217.932192:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909217.932222:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019534336:0@lo:400:kworker.0 00000100:00100000:3.0:1788909217.932413:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909217.932486:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019534208 00000100:00100000:1.0:1788909217.932491:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019534208 00000100:00100000:1.0:1788909217.932517:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788909217.932526:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019534208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909217.932543:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019534592:12345-0@lo:400:kworker.0 Request processed in 581us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909217.932551:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788909217.932572:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019534208:12345-0@lo:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909217.932579:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788909217.932710:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019534208:0@lo:400:kworker.0 00000100:00100000:1.0:1788909217.932753:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019534592:0@lo:400:kworker.0 00000100:00100000:2.0:1788909217.933203:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019534080:12345-0@lo:400:kworker.0 Request processed in 1808us (3870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909217.933214:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788909217.933314:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019534080:0@lo:400:kworker.0 00000100:00100000:3.0:1788909218.015883:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909218.016296:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004849664 00000100:00100000:0.0:1788909218.016306:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004849664 00000100:00100000:0.0:1788909218.016387:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:0.0:1788909218.016397:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:11306:x1875807004849664:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909218.016418:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909218.016436:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5f2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4474d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.016507:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.016530:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.016543:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.016556:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.016579:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.016585:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.017815:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5f44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.017832:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5f44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.017841:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5f44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909218.017852:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788909218.018105:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018139:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018145:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018151:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909218.018155:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018163:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018186:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890510293900) 00010000:00010000:0.0:1788909218.018189:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909218.018193:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018199:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d5f36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018215:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018221:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018226:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018230:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909218.018232:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018237:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018243:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff890513293700) 00010000:00010000:0.0:1788909218.018245:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909218.018247:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018252:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d5f3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788909218.018420:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788909218.018980:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d5f2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4474d expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.018998:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5f44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4474d expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909218.019007:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:0.0:1788909218.019009:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909218.019012:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517c00, rc 0) 00000100:00100000:0.0:1788909218.019089:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:11306:x1875807004849664:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2693us (3216us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788909218.019098:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:3.0:1788909218.022414:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909218.022461:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909218.022484:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004849792 00000100:00100000:2.0:1788909218.022547:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004849792 00000100:00100000:2.0:1788909218.022899:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788909218.022910:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:2350:x1875807004849792:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909218.022928:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909218.022952:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d5f44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4474d expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909218.022997:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:2.0:1788909218.023002:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909218.023141:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004849920 00000100:00100000:1.0:1788909218.023147:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004849920 00000100:00100000:1.0:1788909218.023187:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:1.0:1788909218.023195:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:11306:x1875807004849920:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788909218.023309:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+16:2350:x1875807004849792:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 400us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909218.023318:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788909218.023511:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:11306:x1875807004849920:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 316us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909218.023519:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00010000:00010000:3.0:1788909218.502209:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788909218.502648:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788909218.502666:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788909218.502722:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788909218.502732:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:3.0:1788909218.694439:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788909218.694449:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788909218.694766:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788909218.694773:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788909219.512288:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909219.512617:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004850048 00000100:00100000:3.0:1788909219.512628:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004850048 00000100:00100000:3.0:1788909219.512695:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00100000:3.0:1788909219.512705:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:11349:x1875807004850048:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909219.512725:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909219.512743:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44754 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.512808:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.512822:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.512835:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.512849:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.512857:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.512864:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513147:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513162:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513168:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513174:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909219.513178:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513186:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513198:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:3.0:1788909219.513201:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909219.513206:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513212:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513224:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513229:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513247:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513252:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909219.513260:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513266:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513274:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff890507e13200) 00010000:00010000:3.0:1788909219.513276:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909219.513279:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513284:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513316:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44754 expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513326:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:3.0:1788909219.513328:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909219.513332:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44754 expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.513342:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89050bad9e00, rc 0) 00000100:00100000:3.0:1788909219.513411:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:11349:x1875807004850048:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 707us (1133us total) trans 0 rc 301/301 00000100:00100000:3.0:1788909219.513419:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00100000:3.0:1788909219.522438:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909219.522710:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004850304 00000100:00100000:2.0:1788909219.522721:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004850304 00000100:00100000:2.0:1788909219.522785:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:2.0:1788909219.522796:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:11349:x1875807004850304:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1788909219.522856:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909219.522898:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d58d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4458d expref: 13 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.522919:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:2.0:1788909219.522923:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909219.523257:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.523273:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44746 expref: 5 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.523282:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.523317:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44746 expref: 5 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.523344:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44746 expref: 5 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909219.523360:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019534720:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909219.523468:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c540 going to sleep for 11 seconds 00010000:00010000:0.0:1788909219.525757:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909219.526523:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019534720:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909219.526553:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909219.528244:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909219.528840:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004850432 00000100:00100000:2.0:1788909219.528854:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004850432 00010000:00010000:2.0:1788909219.528939:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44746 expref: 6 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909219.528993:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:2.0:1788909219.529005:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae3d4805-3977-4f79-88af-684dce002b2f+6:2349:x1875807004850432:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909219.529022:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909219.529040:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44746 expref: 6 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.529055:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44746 expref: 6 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.529082:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d5f28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44746 expref: 6 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.529101:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:2.0:1788909219.529106:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.529163:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788909219.529164:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788909219.529170:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.529199:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909219.529229:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.529246:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.529270:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909219.529274:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004850432:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 271us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909219.529282:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00010000:00010000:0.0:1788909219.529285:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.529293:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909219.533600:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788909219.533623:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.533635:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.533643:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.533651:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909219.533656:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.533664:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.533680:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890510293b00) 00010000:00010000:0.0:1788909219.533683:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909219.533688:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.533695:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d5f67 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788909219.533731:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a2b210b reply state 00000000bb7f8a1e transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909219.533741:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788909219.533977:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:11349:x1875807004850304:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 11180us (11547us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788909219.533987:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 140 00010000:00010000:2.0:1788909219.537186:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.537203:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.537211:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.537217:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909219.537222:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.537229:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.537261:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff890513293700) 00010000:00010000:2.0:1788909219.537264:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909219.537270:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.537287:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d5f6e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909219.639784:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909219.640200:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004850560 00000100:00100000:1.0:1788909219.640213:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004850560 00000100:00100000:1.0:1788909219.640318:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:1.0:1788909219.640330:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:11357:x1875807004850560:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:1.0:1788909219.640369:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909219.640394:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d5f75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4475b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.640477:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5f7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.640494:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5f7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.640508:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5f7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909219.640599:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788909219.640604:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909219.640637:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5f7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.640664:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d5f75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4475b expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.640682:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5f7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4475b expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.640692:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5a00) 00010000:00010000:1.0:1788909219.640695:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788909219.640699:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768e00, rc 0) 00000100:00100000:1.0:1788909219.640804:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:11357:x1875807004850560:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 477us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909219.640818:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:0.0:1788909219.696537:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909219.696627:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004850688 00000100:00100000:3.0:1788909219.696650:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004850688 00000100:00100000:3.0:1788909219.696709:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:3.0:1788909219.696718:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:11363:x1875807004850688:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788909219.696738:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909219.696759:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44762 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.696912:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.696928:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.696939:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.696957:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.696964:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.696970:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697565:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890500030000/0x733cfdd8721d5f98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697577:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890500030000/0x733cfdd8721d5f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697586:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890500030000/0x733cfdd8721d5f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909219.697636:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1788909219.697640:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788909219.697679:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890500030000/0x733cfdd8721d5f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697692:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697699:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697706:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697711:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909219.697716:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697722:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697735:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5a00) 00010000:00010000:3.0:1788909219.697738:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909219.697742:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697747:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501535000/0x733cfdd8721d5f8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697761:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697980:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697986:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.697991:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909219.697995:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.698001:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.698011:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff890507e13200) 00010000:00010000:3.0:1788909219.698014:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909219.698017:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.698023:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9e00/0x733cfdd8721d5f91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.698061:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501535600/0x733cfdd8721d5f83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44762 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.698075:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890500030000/0x733cfdd8721d5f98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44762 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.698082:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:3.0:1788909219.698084:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788909219.698093:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890500030000, rc 0) 00000100:00100000:3.0:1788909219.698342:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:11363:x1875807004850688:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1624us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909219.698352:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:2.0:1788909219.702282:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909219.702433:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004850944 00000100:00100000:3.0:1788909219.702443:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004850944 00000100:00100000:3.0:1788909219.702538:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:3.0:1788909219.702548:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+15:11363:x1875807004850944:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788909219.702568:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909219.702587:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890500031c00/0x733cfdd8721d5f9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44769 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.702723:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.702737:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.702749:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.702929:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.702938:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.702945:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788909219.703611:0:7640:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788909219.704009:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704022:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704032:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704066:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704074:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704081:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704087:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890500030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909219.704091:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704220:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704244:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:3.0:1788909219.704247:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909219.704251:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704258:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890500030a00/0x733cfdd8721d5fa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788909219.704283:0:7640:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000430c0033 reply state 000000009e6c3468 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909219.704293:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788909219.704327:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890500031c00/0x733cfdd8721d5f9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44769 expref: 18 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704342:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44769 expref: 17 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.704349:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890507e13c00) 00010000:00010000:3.0:1788909219.704352:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788909219.704354:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6a00, rc 0) 00000100:00100000:3.0:1788909219.704523:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:11363:x1875807004850944:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1975us (2249us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788909219.704532:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 143 00010000:00010000:0.0:1788909219.710417:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.710436:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.710444:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.710450:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890500031400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909219.710456:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.710463:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.710481:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890507e13100) 00010000:00010000:0.0:1788909219.710484:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909219.710489:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.710495:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890500031400/0x733cfdd8721d5fad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909219.713180:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909219.713571:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004851072 00000100:00100000:3.0:1788909219.713587:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004851072 00000100:00100000:3.0:1788909219.713717:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1788909219.713728:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004851072:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788909219.713746:0:8092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909219.713766:0:8092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44770 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909219.713794:0:8092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788909219.713820:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1788909219.713839:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909219.713850:0:8092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44770 expref: 6 pid: 8092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.713876:0:8092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44770 expref: 6 pid: 8092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.713891:0:8092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6800, rc 0) 00000100:00100000:3.0:1788909219.713979:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004851072:12345-192.168.204.54@tcp:101:bash.0 Request processed in 254us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909219.713986:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00080000:0.0:1788909219.714434:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909219.722284:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909219.722422:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004851200 00000100:00100000:3.0:1788909219.722434:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004851200 00000100:00100000:1.0:1788909219.722533:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1788909219.722546:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:11363:x1875807004851200:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788909219.722565:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909219.722582:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44777 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.722614:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44770 expref: 7 pid: 8092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.722623:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909219.722628:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909219.722634:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.722670:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44770 expref: 7 pid: 8092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.722685:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44770 expref: 7 pid: 8092 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909219.722699:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890504e57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6676:1875807019534848:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909219.722843:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788909219.727301:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909219.727409:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890504e57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6676:1875807019534848:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909219.727416:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004851328 00000100:00100000:0.0:1788909219.727426:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004851328 00010000:00010000:3.0:1788909219.727449:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.727469:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44770 expref: 8 pid: 8092 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.727474:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769a00, rc 0) 00000100:00100000:0.0:1788909219.727530:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1788909219.727542:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004851328:12345-192.168.204.54@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788909219.727548:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:11363:x1875807004851200:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5003us (5274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909219.727557:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00010000:00010000:0.0:1788909219.727573:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909219.727599:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44770 expref: 7 pid: 8092 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.727613:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44770 expref: 7 pid: 8092 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.727650:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fa0568/0x733cfdd8721d5fc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44770 expref: 7 pid: 8092 timeout: 401 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.727667:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909219.727671:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909219.727679:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.727690:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.728425:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909219.728446:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1875807019534976:192.168.204.54@tcp:105: 00000100:00100000:0.0:1788909219.728534:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905090c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788909219.732206:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909219.732967:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004851584 00000100:00100000:2.0:1788909219.732983:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004851584 00000100:00100000:2.0:1788909219.733070:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1788909219.733085:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:11363:x1875807004851584:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1788909219.733270:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1875807019534976:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788909219.733290:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909219.733341:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2350:x1875807004851328:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 5801us (6049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909219.733351:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1788909219.733426:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:11363:x1875807004851584:12345-192.168.204.54@tcp:35:bash.0 Request processed in 345us (1231us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788909219.733434:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1788909219.799599:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909219.799990:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004851840 00000100:00100000:0.0:1788909219.800001:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004851840 00000100:00100000:3.0:1788909219.800133:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:3.0:1788909219.800146:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:11373:x1875807004851840:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909219.800170:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909219.800191:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d5fd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4477e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909219.800340:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788909219.800457:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d5fd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4477e expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.800472:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5a00) 00010000:00010000:3.0:1788909219.800475:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788909219.800481:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d5fd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4477e expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.800493:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6200, rc 0) 00000100:00100000:3.0:1788909219.800550:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:11373:x1875807004851840:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 408us (961us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788909219.800555:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:3.0:1788909219.807461:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909219.807610:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004852096 00000100:00100000:2.0:1788909219.807702:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004852096 00000100:00100000:2.0:1788909219.807905:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1788909219.808161:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:11373:x1875807004852096:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909219.809441:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:11373:x1875807004852096:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 1514us (1986us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788909219.809456:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:1.0:1788909219.870811:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909219.871162:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004852224 00000100:00100000:0.0:1788909219.871176:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004852224 00000100:00100000:0.0:1788909219.871308:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:0.0:1788909219.871322:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:11379:x1875807004852224:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909219.871359:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909219.871386:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d5fde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44785 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.871481:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d5fe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.871500:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d5fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.871538:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d5fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909219.871625:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1788909219.871629:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909219.871659:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d5fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.871695:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d5fde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44785 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.871716:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d5fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44785 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.871726:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:0.0:1788909219.871730:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788909219.871734:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517200, rc 0) 00000100:00100000:0.0:1788909219.871816:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:11379:x1875807004852224:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 497us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909219.871825:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:0.0:1788909219.878493:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909219.878671:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004852480 00000100:00100000:2.0:1788909219.878686:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004852480 00000100:00100000:2.0:1788909219.878768:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:2.0:1788909219.878781:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:11379:x1875807004852480:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909219.878808:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909219.878854:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5fec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4478c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.879023:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.879044:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.879060:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909219.879074:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788909219.879694:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d5fec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4478c expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.879718:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4478c expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.879729:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890507e13c00) 00010000:00010000:2.0:1788909219.879732:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909219.879736:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10a00, rc 0) 00000100:00100000:2.0:1788909219.880044:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:11379:x1875807004852480:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1265us (1570us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788909219.880054:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:1.0:1788909219.884257:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909219.884391:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004852736 00000100:00100000:3.0:1788909219.884406:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004852736 00000100:00100000:0.0:1788909219.884429:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909219.884494:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:2.0:1788909219.884502:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004852864 00000100:00100000:2.0:1788909219.884509:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004852864 00000100:00100000:0.0:1788909219.884511:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:11379:x1875807004852736:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909219.884548:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788909219.884566:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1788909219.884578:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:2349:x1875807004852864:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909219.884582:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6001 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44793 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.884626:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909219.884757:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6008 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.884892:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d5ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4478c expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.885514:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.885533:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890507e13c00) 00010000:00010000:0.0:1788909219.885533:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.885542:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1788909219.885557:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:2.0:1788909219.885649:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:2349:x1875807004852864:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1063us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909219.885660:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00010000:00010000:0.0:1788909219.885773:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6001 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44793 expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.885792:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6008 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44793 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.885801:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890507e13c00) 00010000:00010000:0.0:1788909219.885805:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788909219.885808:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517800, rc 0) 00000100:00100000:0.0:1788909219.885857:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11379:x1875807004852736:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1352us (1619us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788909219.885865:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:0.0:1788909219.896445:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909219.896583:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004852992 00000100:00100000:3.0:1788909219.896598:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004852992 00000100:00100000:3.0:1788909219.896728:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:3.0:1788909219.896742:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004852992:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:3.0:1788909219.896824:0:8092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.896856:0:8092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.896895:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909219.896901:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788909219.896907:0:8092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.896976:0:8092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.896994:0:8092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 6 pid: 6676 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909219.897013:0:8092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905069c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8092:1875807019535104:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909219.897194:0:8092:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979000 going to sleep for 11 seconds 00000100:00100000:3.0:1788909219.904198:0:8092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905069c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8092:1875807019535104:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909219.904258:0:8092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909219.906483:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909219.908543:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004853120 00000100:00100000:3.0:1788909219.908567:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004853120 00002000:00100000:3.0:1788909219.908663:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff890537f69180 x1875807004853120/t0(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:150/0 lens 504/0 e 0 to 0 dl 1788909230 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788909219.908678:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff890537f69180 with x1875807004853120 ext(0->12) 00010000:00010000:3.0:1788909219.908691:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 7 pid: 6676 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.908745:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 7 pid: 6676 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909219.908755:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff890537f69180 00000100:00100000:3.0:1788909219.908858:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788909219.908871:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004853120:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:3.0:1788909219.909602:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2350:x1875807004853120:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 729us (3128us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788909219.909613:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00002000:00100000:3.0:1788909219.909622:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff890537f69180 x1875807004853120/t4294967305(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:150/0 lens 504/448 e 0 to 0 dl 1788909230 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788909219.909630:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff890537f69180 with x1875807004853120 ext(0->12) 00010000:00010000:3.0:1788909219.909638:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 9 pid: 6676 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909219.909654:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 9 pid: 6676 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909219.909661:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff890537f69180 00000100:00100000:0.0:1788909219.914207:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909219.914345:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004853248 00000100:00100000:2.0:1788909219.914361:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004853248 00010000:00010000:2.0:1788909219.914422:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 9 pid: 6676 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909219.914520:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1788909219.914532:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2347:x1875807004853248:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909219.914551:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788909219.914578:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788909219.914582:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788909219 00002000:00010000:2.0:1788909219.914584:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788909219 00002000:00010000:2.0:1788909219.914586:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788909219 00010000:00010000:2.0:1788909219.914594:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 9 pid: 6676 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.914609:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 9 pid: 6676 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.914659:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000630186ab/0x733cfdd8721d5fc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44777 expref: 9 pid: 6676 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.914682:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788909219.914688:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788909219.914696:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.914709:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909219.914761:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909219.914847:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2347:x1875807004853248:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 316us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909219.914856:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00010000:00010000:1.0:1788909219.916147:0:8092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.916169:0:8092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.916210:0:8092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.916233:0:8092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.916243:0:8092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.916252:0:8092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909219.916258:0:8092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.916268:0:8092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.916288:0:8092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.916328:0:8092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000774de628/0x733cfdd8721d6016 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909219.916898:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2347:x1875807004852992:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 20139us (20451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909219.916929:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:0.0:1788909219.919486:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909219.919613:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004853504 00000100:00100000:1.0:1788909219.919628:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004853504 00000100:00100000:1.0:1788909219.919799:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1788909219.919813:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11379:x1875807004853504:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:1.0:1788909219.919909:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6008 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44793 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788909219.920311:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788909219.920362:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788909219.921565:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788909219.921670:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.921697:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44769 expref: 28 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.921809:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.921865:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44769 expref: 28 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.921887:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44769 expref: 28 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909219.921906:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875807019535232:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909219.922041:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905090c9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909219.925273:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909219.925515:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004853632 00000100:00100000:1.0:1788909219.925528:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004853632 00010000:00010000:1.0:1788909219.925590:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44769 expref: 29 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909219.925642:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788909219.925655:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:2349:x1875807004853632:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909219.925673:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909219.925682:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44769 expref: 29 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.925697:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44769 expref: 29 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.925871:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890507e13c00) 00010000:00010000:1.0:1788909219.925878:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.925889:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.925898:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909219.925932:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909219.926012:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:2349:x1875807004853632:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 359us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909219.926021:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00010000:00010000:0.0:1788909219.927448:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6a00/0x733cfdd8721d5fb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44769 expref: 28 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909219.927488:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875807019535232:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909219.927525:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.927538:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.927565:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788909219.927824:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788909219.930332:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788909219.930492:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875807019535360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788909219.930570:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909219.930608:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502bf6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788909219.930915:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019535360 00000100:00100000:1.0:1788909219.931000:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019535360 00000100:00080000:0.0:1788909219.931869:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909219.932066:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788909219.932085:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875807019535360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788909219.932280:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875807019535360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 201us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909219.932288:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788909219.932510:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875807019535360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788909219.935038:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788909219.935430:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875807019535488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788909219.935493:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909219.935535:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff890504e096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909219.935626:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019535488 00000100:00100000:3.0:1788909219.935635:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019535488 00000100:00100000:3.0:1788909219.935923:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788909219.935934:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875807019535488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788909219.936608:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1875807019535488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 674us (1112us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788909219.936617:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788909219.936846:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875807019535488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788909219.936907:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788909219.936949:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.936958:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.936965:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.936970:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909219.936974:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.936994:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.937012:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890507e13c00) 00010000:00010000:0.0:1788909219.937015:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788909219.937019:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.937025:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d601d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788909219.937533:0:5825:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788909219.937777:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788909219.937788:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302011678386ns, next at 303011676348ns, rc = 0 00000001:00080000:0.0:1788909219.937795:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788909219.937834:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890507e13c00) 00010000:00010000:0.0:1788909219.937837:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788909219.937844:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6008 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44793 expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909219.938033:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:11379:x1875807004853504:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 18223us (18561us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788909219.938043:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000020:00080000:0.0:1788909219.938048:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788909219.943556:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909219.943664:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004853760 00000100:00100000:0.0:1788909219.943682:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004853760 00000100:00100000:0.0:1788909219.943762:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:0.0:1788909219.943775:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:11379:x1875807004853760:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909219.943819:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909219.943852:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6024 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4479a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.943916:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4479a expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.943930:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4479a expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909219.943948:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:0.0:1788909219.943951:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909219.943955:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517800, rc 0) 00000100:00100000:0.0:1788909219.944511:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:11379:x1875807004853760:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 736us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909219.944518:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:3.0:1788909219.950982:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909219.955703:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004854016 00000100:00100000:2.0:1788909219.955722:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004854016 00000100:00100000:2.0:1788909219.955969:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1788909219.955980:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:11379:x1875807004854016:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909219.956928:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:11379:x1875807004854016:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 945us (5955us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788909219.956938:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:3.0:1788909220.040636:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.040941:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004854272 00000100:00100000:0.0:1788909220.040953:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004854272 00000100:00100000:0.0:1788909220.041050:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:0.0:1788909220.041062:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+33:11389:x1875807004854272:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909220.041089:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909220.041152:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d602b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447a1 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788909220.041277:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788909220.041300:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788909220.041438:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d602b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447a1 expref: 35 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.041474:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5a00) 00010000:00010000:0.0:1788909220.041478:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788909220.041484:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d602b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447a1 expref: 35 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.041506:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516e00, rc 0) 00000100:00100000:0.0:1788909220.041590:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:11389:x1875807004854272:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 531us (968us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788909220.041597:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 149 00000100:00100000:3.0:1788909220.050303:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.050770:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004854400 00000100:00100000:2.0:1788909220.050781:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004854400 00000100:00100000:2.0:1788909220.050870:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:2.0:1788909220.050896:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:11389:x1875807004854400:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788909220.050985:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051004:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051017:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051032:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051039:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051046:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051213:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051234:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051242:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909220.051289:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051303:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051317:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051324:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051331:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909220.051336:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051344:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051357:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909220.051360:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909220.051364:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051370:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6039 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051396:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051403:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051408:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051413:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909220.051422:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051429:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051437:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293200) 00010000:00010000:2.0:1788909220.051439:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909220.051442:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051447:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6040 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051460:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051465:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051470:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051475:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909220.051477:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051482:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051489:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909220.051491:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909220.051501:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.051507:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6047 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909220.051593:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:11389:x1875807004854400:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 698us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909220.051602:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:3.0:1788909220.054411:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.054482:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004854656 00000100:00100000:0.0:1788909220.054493:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004854656 00000100:00100000:0.0:1788909220.054557:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:0.0:1788909220.054568:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:11389:x1875807004854656:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788909220.054852:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:11389:x1875807004854656:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 284us (450us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788909220.054862:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788909220.091310:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.091391:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004854912 00000100:00100000:0.0:1788909220.091403:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004854912 00000100:00100000:0.0:1788909220.091486:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:0.0:1788909220.091498:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:11392:x1875807004854912:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909220.091527:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909220.091544:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d604e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447a8 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091623:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091653:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091667:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091683:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091690:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091697:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091844:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091854:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091861:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909220.091872:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788909220.091971:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091978:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091984:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.091997:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909220.092002:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092009:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092021:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:0.0:1788909220.092024:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909220.092028:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092034:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6055 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092053:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092059:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092065:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092070:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909220.092072:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092079:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092172:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890513293200) 00010000:00010000:0.0:1788909220.092176:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909220.092179:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092186:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d605c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092246:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d604e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447a8 expref: 38 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092261:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447a8 expref: 37 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.092269:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:0.0:1788909220.092271:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909220.092274:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516800, rc 0) 00000100:00100000:0.0:1788909220.092355:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:11392:x1875807004854912:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 858us (1067us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788909220.092365:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 151 00000100:00100000:3.0:1788909220.094855:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.095061:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004855040 00000100:00100000:0.0:1788909220.095071:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004855040 00000100:00100000:0.0:1788909220.095291:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:0.0:1788909220.095311:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:11392:x1875807004855040:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1788909220.095414:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.095430:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.095462:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.095491:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.095499:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.095506:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.095517:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909220.095521:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.095528:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.095541:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:0.0:1788909220.095544:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788909220.095549:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.095554:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909220.095678:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:11392:x1875807004855040:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 369us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909220.095686:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 152 00000100:00100000:3.0:1788909220.099531:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.099627:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004855296 00000100:00100000:0.0:1788909220.099652:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004855296 00000100:00100000:0.0:1788909220.099720:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:0.0:1788909220.099731:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:11392:x1875807004855296:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788909220.100637:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+38:11392:x1875807004855296:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 903us (1113us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788909220.100648:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1788909220.273358:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.273499:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004855552 00000100:00100000:0.0:1788909220.273520:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004855552 00000100:00100000:0.0:1788909220.273634:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00100000:0.0:1788909220.273647:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+38:11423:x1875807004855552:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:0.0:1788909220.273685:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909220.273715:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6078 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447af expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.273825:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d607f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.273840:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d607f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.273853:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d607f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909220.273865:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788909220.274006:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6078 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447af expref: 41 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.274031:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d607f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447af expref: 40 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.274066:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:0.0:1788909220.274069:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909220.274073:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516e00, rc 0) 00000100:00100000:0.0:1788909220.274233:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+40:11423:x1875807004855552:12345-192.168.204.54@tcp:101:cat.0 Request processed in 588us (895us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788909220.274240:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 153 00000100:00100000:3.0:1788909220.277776:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.278728:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004855680 00000100:00100000:0.0:1788909220.278745:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004855680 00000100:00100000:0.0:1788909220.278943:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788909220.278957:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+40:2348:x1875807004855680:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909220.278992:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909220.279026:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d607f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447af expref: 40 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.279052:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:0.0:1788909220.279058:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909220.279170:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+39:2348:x1875807004855680:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 216us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909220.279179:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788909220.279258:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909220.279427:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004855936 00000100:00100000:1.0:1788909220.279433:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004855936 00000100:00100000:1.0:1788909220.279479:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1788909220.279490:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+39:11423:x1875807004855936:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:1.0:1788909220.279779:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+40:11423:x1875807004855936:12345-192.168.204.54@tcp:35:cat.0 Request processed in 292us (521us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788909220.279807:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788909220.320265:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.320938:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004856192 00000100:00100000:2.0:1788909220.320956:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004856192 00000100:00100000:2.0:1788909220.321165:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:2.0:1788909220.321181:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+40:11429:x1875807004856192:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1788909220.321231:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909220.321235:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788909220.321274:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d5fe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44785 expref: 40 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.321301:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909220.321308:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909220.321340:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d608d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447b6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.321488:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.321507:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447a8 expref: 40 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.321518:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.321589:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447a8 expref: 40 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.321607:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447a8 expref: 40 pid: 7640 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909220.321624:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019535616:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909220.321786:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788909220.326517:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.326556:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019535616:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909220.326594:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909220.327700:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004856320 00000100:00100000:1.0:1788909220.327719:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004856320 00010000:00010000:1.0:1788909220.327802:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447a8 expref: 41 pid: 7640 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909220.327857:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1788909220.327870:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+41:2349:x1875807004856320:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909220.327890:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909220.327899:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447a8 expref: 41 pid: 7640 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.327913:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447a8 expref: 41 pid: 7640 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.327957:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d6063 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447a8 expref: 41 pid: 7640 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.327986:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:1.0:1788909220.327993:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.328005:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.328015:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.328076:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909220.328227:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+40:2349:x1875807004856320:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 338us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909220.328238:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00010000:00010000:2.0:1788909220.328444:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.328453:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909220.328481:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788909220.328709:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d608d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447b6 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.328731:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447b6 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.328740:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909220.328742:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788909220.328754:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10000, rc 0) 00000100:00100000:2.0:1788909220.328800:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+40:11429:x1875807004856192:12345-192.168.204.54@tcp:101:dd.0 Request processed in 7624us (8551us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788909220.328809:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 154 00000100:00100000:3.0:1788909220.332259:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.332383:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004856576 00000100:00100000:0.0:1788909220.332399:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004856576 00000100:00100000:0.0:1788909220.332480:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 155 00000100:00100000:0.0:1788909220.332494:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+40:11429:x1875807004856576:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:0.0:1788909220.332972:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.333009:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.333025:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788909220.333106:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788909220.333167:0:7640:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fb96b01 reply state 00000000648040cb transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909220.333179:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788909220.333321:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+43:11429:x1875807004856576:12345-192.168.204.54@tcp:36:dd.0 Request processed in 828us (1078us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788909220.333330:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 155 00000020:00080000:0.0:1788909220.333335:0:7640:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788909220.337098:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.337162:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.337172:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.337179:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909220.337186:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.337197:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.337228:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909220.337231:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909220.337237:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.337243:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d60a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909220.529379:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.529642:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004856704 00000100:00100000:0.0:1788909220.529655:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004856704 00000100:00100000:0.0:1788909220.529739:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 156 00000100:00100000:0.0:1788909220.529751:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+42:11443:x1875807004856704:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:0.0:1788909220.529782:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909220.529811:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d60a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447bd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.529902:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530050:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530065:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530104:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530142:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530150:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530307:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530321:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447b6 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530331:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530388:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447b6 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.530407:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447b6 expref: 43 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909220.530427:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019535744:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909220.530607:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905090c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909220.533710:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.534729:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019535744:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909220.534768:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909220.535645:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004856960 00000100:00100000:2.0:1788909220.535659:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004856960 00000100:00100000:2.0:1788909220.535935:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:2.0:1788909220.535949:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+44:6050:x1875807004856960:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788909220.536582:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+45:6050:x1875807004856960:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 632us (2887us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788909220.536593:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:3.0:1788909220.542454:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.542574:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004857088 00000100:00100000:2.0:1788909220.542588:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004857088 00010000:00010000:2.0:1788909220.542692:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447b6 expref: 45 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909220.542872:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:2.0:1788909220.542884:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+45:2350:x1875807004857088:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909220.542903:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909220.542919:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447b6 expref: 45 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.542936:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447b6 expref: 45 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.542965:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6094 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447b6 expref: 45 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.542990:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909220.542995:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.543007:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.543015:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.543071:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909220.543193:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+44:2350:x1875807004857088:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 311us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909220.543201:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00010000:00010000:1.0:1788909220.543328:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543339:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909220.543402:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788909220.543408:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909220.543447:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543463:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543475:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543483:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543490:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543497:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909220.543502:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543525:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543542:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:1.0:1788909220.543546:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909220.543551:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543558:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d60b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543581:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543587:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543594:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543600:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909220.543603:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543609:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543617:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890513293200) 00010000:00010000:1.0:1788909220.543619:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909220.543623:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543651:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d60b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543704:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d60a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447bd expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543721:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447bd expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.543730:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:1.0:1788909220.543733:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909220.543736:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516a00, rc 0) 00000100:00100000:1.0:1788909220.543785:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+43:11443:x1875807004856704:12345-192.168.204.54@tcp:101:stat.0 Request processed in 14036us (14420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909220.543793:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 156 00010000:00010000:1.0:1788909220.549383:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909220.601615:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.601994:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004857344 00000100:00100000:2.0:1788909220.602010:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004857344 00000100:00100000:2.0:1788909220.602178:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 157 00000100:00100000:2.0:1788909220.602197:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+43:11449:x1875807004857344:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:2.0:1788909220.602324:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909220.602362:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d60be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447bd expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.602397:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909220.602403:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909220.602747:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.602764:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.602777:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788909220.602840:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788909220.602869:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adff656f reply state 00000000fd5b57a9 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909220.602879:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788909220.603063:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+45:11449:x1875807004857344:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 871us (1465us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788909220.603074:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 157 00000020:00080000:2.0:1788909220.603081:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788909220.604995:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.605022:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.605031:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.605038:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909220.605045:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.605054:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.605079:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:0.0:1788909220.605083:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909220.605089:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.605096:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d60c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909220.708610:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.708816:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004857472 00000100:00100000:2.0:1788909220.708830:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004857472 00000100:00100000:2.0:1788909220.708993:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 158 00000100:00100000:2.0:1788909220.709010:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+44:11463:x1875807004857472:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:2.0:1788909220.709047:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909220.709075:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d60cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447c4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709220:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709244:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709259:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709279:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709286:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709294:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709453:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709486:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709493:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909220.709558:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788909220.709564:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909220.709602:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709618:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709628:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709636:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709644:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709650:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909220.709656:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709664:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709678:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909220.709687:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909220.709694:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709703:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709721:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709727:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709733:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709739:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909220.709742:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709748:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709756:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293200) 00010000:00010000:2.0:1788909220.709759:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909220.709762:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709768:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11600/0x733cfdd8721d60da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709812:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d60cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447c4 expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709841:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447c4 expref: 45 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.709850:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909220.709852:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909220.709855:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10200, rc 0) 00000100:00100000:2.0:1788909220.710018:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+45:11463:x1875807004857472:12345-192.168.204.54@tcp:101:stat.0 Request processed in 1012us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909220.710027:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 158 00000100:00100000:3.0:1788909220.767371:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.767847:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004857728 00000100:00100000:2.0:1788909220.767862:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004857728 00000100:00100000:2.0:1788909220.767975:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:2.0:1788909220.767992:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+45:11473:x1875807004857728:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909220.768029:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909220.768066:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d60e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447cb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909220.768323:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788909220.768532:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d60e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447cb expref: 47 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.768553:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5a00) 00010000:00010000:2.0:1788909220.768556:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909220.768563:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d60e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447cb expref: 47 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.768609:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11c00, rc 0) 00000100:00100000:2.0:1788909220.768709:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+46:11473:x1875807004857728:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 721us (1352us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788909220.768717:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 159 00000100:00100000:3.0:1788909220.772590:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909220.772801:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004857984 00000100:00100000:1.0:1788909220.772816:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004857984 00000100:00100000:1.0:1788909220.773426:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:1.0:1788909220.773443:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+46:11473:x1875807004857984:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788909220.773875:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+47:11473:x1875807004857984:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 435us (1302us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788909220.773888:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788909220.815362:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909220.815518:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004858240 00000100:00100000:1.0:1788909220.815533:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004858240 00000100:00100000:2.0:1788909220.815674:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:2.0:1788909220.815691:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+47:11479:x1875807004858240:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909220.815726:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909220.815759:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d60f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447d2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.816054:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.816075:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447c4 expref: 48 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.816085:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.816167:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447c4 expref: 48 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.816313:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447c4 expref: 48 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909220.816334:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cbf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019535872:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909220.816550:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788909220.822651:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909220.822919:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004858368 00000100:00100000:1.0:1788909220.822957:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004858368 00010000:00010000:1.0:1788909220.823022:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447c4 expref: 49 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909220.823171:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788909220.823195:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+49:2349:x1875807004858368:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909220.823225:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909220.823235:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447c4 expref: 49 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.823253:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447c4 expref: 49 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.823285:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:1.0:1788909220.823292:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.823304:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.823314:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.823339:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909220.823437:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+49:2349:x1875807004858368:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 255us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909220.823445:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00010000:00010000:0.0:1788909220.823459:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d60e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447c4 expref: 49 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909220.824079:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cbf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019535872:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909220.824192:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.824237:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.824244:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909220.824275:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788909220.824516:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d60f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447d2 expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.824540:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447d2 expref: 48 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.824549:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:0.0:1788909220.824552:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788909220.824555:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10a00, rc 0) 00000100:00100000:0.0:1788909220.824617:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+48:11479:x1875807004858240:12345-192.168.204.54@tcp:101:bash.0 Request processed in 8932us (9270us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788909220.824626:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 160 00000100:00100000:3.0:1788909220.831625:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.831742:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004858624 00000100:00100000:2.0:1788909220.831757:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004858624 00000100:00100000:2.0:1788909220.831852:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 161 00000100:00100000:2.0:1788909220.831866:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+48:11479:x1875807004858624:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:2.0:1788909220.833255:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.833288:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.833313:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788909220.833399:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788909220.833431:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e675dcc8 reply state 000000000421395b transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909220.833442:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788909220.833781:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+51:11479:x1875807004858624:12345-192.168.204.54@tcp:36:bash.0 Request processed in 1913us (2171us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788909220.833793:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 161 00000020:00080000:2.0:1788909220.834074:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788909220.836530:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.836582:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.836590:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.836596:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909220.836600:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.836607:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.836629:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:1.0:1788909220.836631:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909220.836636:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.836640:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d610b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909220.842508:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909220.842854:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004858752 00000100:00100000:1.0:1788909220.842867:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004858752 00000100:00100000:1.0:1788909220.842941:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:1.0:1788909220.842952:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:11479:x1875807004858752:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788909220.842979:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909220.843000:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6112 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447d9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.843099:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.843167:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447d2 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.843177:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.843234:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447d2 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.843249:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447d2 expref: 51 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909220.843263:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537405500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019536000:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909220.843369:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085a8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788909220.846456:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537405500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019536000:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909220.846459:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:1.0:1788909220.846503:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909220.846566:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004858880 00000100:00100000:0.0:1788909220.846578:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004858880 00010000:00010000:0.0:1788909220.846641:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447d2 expref: 52 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909220.846690:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1788909220.846704:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:2349:x1875807004858880:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909220.846733:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909220.846766:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447d2 expref: 52 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.846782:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447d2 expref: 52 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.846810:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d60fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447d2 expref: 52 pid: 5822 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.846832:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:0.0:1788909220.846840:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.846851:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.846860:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.846895:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788909220.846969:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.846979:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909220.847038:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788909220.847044:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909220.847070:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.847223:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6112 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447d9 expref: 52 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909220.847223:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:2349:x1875807004858880:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 505us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909220.847250:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00010000:00010000:1.0:1788909220.847271:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447d9 expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.847285:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:1.0:1788909220.847288:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909220.847293:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768000, rc 0) 00000100:00100000:1.0:1788909220.847397:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cc39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:11479:x1875807004858752:12345-192.168.204.54@tcp:101:bash.0 Request processed in 4444us (4902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909220.847407:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 162 00000100:00100000:2.0:1788909220.850106:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.850218:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004859136 00000100:00100000:0.0:1788909220.850231:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004859136 00000100:00100000:0.0:1788909220.850337:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:0.0:1788909220.850351:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:11479:x1875807004859136:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1788909220.850684:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+51:11479:x1875807004859136:12345-192.168.204.54@tcp:35:bash.0 Request processed in 334us (595us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788909220.850723:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788909220.893708:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.893776:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004859392 00000100:00100000:0.0:1788909220.893788:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004859392 00000100:00100000:0.0:1788909220.894236:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:0.0:1788909220.894249:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+51:11489:x1875807004859392:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909220.894279:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909220.894305:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447e0 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909220.894443:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788909220.894573:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6120 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447e0 expref: 53 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.894587:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5a00) 00010000:00010000:0.0:1788909220.894590:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788909220.894595:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447e0 expref: 53 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.894612:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516000, rc 0) 00000100:00100000:0.0:1788909220.895733:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:11489:x1875807004859392:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1473us (2023us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788909220.895746:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:2.0:1788909220.899994:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.902184:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004859520 00000100:00100000:0.0:1788909220.902223:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004859520 00000100:00100000:0.0:1788909220.902343:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1788909220.902357:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:11489:x1875807004859520:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1788909220.902480:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902500:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902514:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902532:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902540:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902547:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902707:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902717:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902725:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788909220.902768:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902782:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902800:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902819:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902825:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909220.902830:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902838:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902850:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:0.0:1788909220.902857:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909220.902873:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902881:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d612e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902904:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902909:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902915:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902921:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909220.902936:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902943:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902952:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890513293800) 00010000:00010000:0.0:1788909220.902955:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909220.902958:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902964:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902979:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902984:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902988:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.902994:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909220.902996:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.903002:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.903010:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:0.0:1788909220.903012:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909220.903021:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909220.903027:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d613c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909220.903176:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:11489:x1875807004859520:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 821us (3194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909220.903187:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:3.0:1788909220.906014:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909220.907521:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004859776 00000100:00100000:0.0:1788909220.907557:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004859776 00000100:00100000:0.0:1788909220.907678:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788909220.907691:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:11489:x1875807004859776:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788909220.908046:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+53:11489:x1875807004859776:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 357us (2051us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788909220.908054:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1788909220.937337:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.937457:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004860032 00000100:00100000:2.0:1788909220.937474:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004860032 00000100:00100000:2.0:1788909220.937613:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:2.0:1788909220.937626:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+53:11492:x1875807004860032:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909220.937672:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909220.937702:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6143 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447e7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.937788:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.937803:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.937817:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.937832:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.937839:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.937846:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.937994:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938002:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938009:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909220.938019:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788909220.938185:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938193:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938200:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938216:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909220.938220:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938226:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938239:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909220.938242:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909220.938247:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938253:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d614a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938267:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938273:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938280:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938284:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909220.938294:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938300:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938308:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293200) 00010000:00010000:2.0:1788909220.938311:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909220.938314:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938320:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6151 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938366:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6143 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447e7 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938381:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447e7 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.938389:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909220.938391:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909220.938393:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909220.938484:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:11492:x1875807004860032:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 860us (1162us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788909220.938498:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:2.0:1788909220.943257:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909220.943311:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909220.943369:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004860160 00000100:00100000:1.0:1788909220.943384:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004860160 00000100:00100000:3.0:1788909220.943463:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004860288 00000100:00100000:1.0:1788909220.943464:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:3.0:1788909220.943467:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004860288 00000100:00100000:1.0:1788909220.943475:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:11492:x1875807004860160:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788909220.943572:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.943596:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.943611:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.943661:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.943691:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.943698:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.943705:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909220.943711:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.943720:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.943736:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:1.0:1788909220.943739:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788909220.943743:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909220.943760:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909220.943789:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788909220.943800:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:2349:x1875807004860288:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909220.943822:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909220.943841:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447e7 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909220.943856:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909220.943859:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909220.943871:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:11492:x1875807004860160:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 398us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909220.943877:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:2349:x1875807004860288:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 82us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909220.943879:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:2.0:1788909220.943884:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788909220.948797:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909220.949263:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004860544 00000100:00100000:1.0:1788909220.949282:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004860544 00000100:00100000:1.0:1788909220.949401:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:1.0:1788909220.949415:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:11492:x1875807004860544:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788909220.949794:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:11492:x1875807004860544:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 382us (1759us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788909220.949816:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1788909221.058827:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909221.059153:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004860800 00000100:00100000:2.0:1788909221.059167:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004860800 00000100:00100000:2.0:1788909221.059246:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1788909221.059259:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:11510:x1875807004860800:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788909221.059291:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909221.059320:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d616d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447ee expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.059450:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6174 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.059467:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.059481:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909221.059494:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788909221.059651:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d616d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447ee expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.059672:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447ee expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.059681:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909221.059684:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788909221.059687:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11200, rc 0) 00000100:00100000:2.0:1788909221.059764:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11510:x1875807004860800:12345-192.168.204.54@tcp:101:cat.0 Request processed in 508us (951us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788909221.059771:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:2.0:1788909221.077801:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.077914:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004860928 00000100:00100000:0.0:1788909221.077936:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004860928 00000100:00100000:0.0:1788909221.078028:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:0.0:1788909221.078040:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11511:x1875807004860928:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909221.078068:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909221.078094:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.078252:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d6189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.078271:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d6189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.078380:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d6189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909221.078457:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1788909221.078462:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909221.078488:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d6189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.078523:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447f5 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.078549:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d6189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447f5 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.078559:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:0.0:1788909221.078562:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788909221.078566:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517c00, rc 0) 00000100:00100000:0.0:1788909221.078654:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11511:x1875807004860928:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 616us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.078662:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:0.0:1788909221.086836:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909221.087047:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004861312 00000100:00100000:2.0:1788909221.087058:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004861312 00000100:00100000:2.0:1788909221.087174:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1788909221.087187:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11511:x1875807004861312:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909221.087631:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11511:x1875807004861312:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 444us (807us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788909221.087640:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788909221.092217:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909221.092461:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004861440 00000100:00100000:2.0:1788909221.092475:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004861440 00000100:00100000:2.0:1788909221.092572:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788909221.092584:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11511:x1875807004861440:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:2.0:1788909221.092603:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788909221.092634:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d6119 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447d9 expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.092850:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447ee expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.092869:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6024 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4479a expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.092880:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293f00) 00010000:00010000:2.0:1788909221.092892:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909221.093541:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:11511:x1875807004861440:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 957us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909221.093553:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788909221.096827:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.097080:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004861568 00000100:00100000:0.0:1788909221.097091:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004861568 00000100:00100000:0.0:1788909221.097182:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:0.0:1788909221.097194:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:11511:x1875807004861568:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:0.0:1788909221.097516:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.097555:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.097568:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788909221.098551:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788909221.098665:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:11511:x1875807004861568:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 1469us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.098675:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 169 00000100:00100000:3.0:1788909221.119312:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909221.119809:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004861696 00000100:00100000:1.0:1788909221.119832:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004861696 00000100:00100000:1.0:1788909221.119901:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:1.0:1788909221.119912:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:11513:x1875807004861696:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788909221.120176:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909221.120223:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6197 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a447fc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120325:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120345:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120372:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120394:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120401:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120409:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120530:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120556:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120564:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909221.120627:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788909221.120632:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909221.120655:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120669:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120679:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120686:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120702:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120709:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909221.120713:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120720:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120731:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:1.0:1788909221.120735:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909221.120745:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120757:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d619e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120773:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120779:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120784:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120789:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909221.120792:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120798:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120810:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890520ac5000) 00010000:00010000:1.0:1788909221.120813:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909221.120816:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120826:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d61a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120862:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6197 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447fc expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120890:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447fc expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.120899:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293800) 00010000:00010000:1.0:1788909221.120901:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788909221.120904:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768a00, rc 0) 00000100:00100000:1.0:1788909221.121001:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11513:x1875807004861696:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1089us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909221.121011:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00010000:00010000:0.0:1788909221.573422:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788909221.767095:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788909221.767105:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788909221.767225:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788909221.767231:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788909221.767356:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019536128:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788909221.767474:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905090c9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788909221.770314:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019536128:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788909221.770780:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.771335:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004861824 00000100:00100000:0.0:1788909221.771346:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004861824 00000100:00100000:0.0:1788909221.771494:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:0.0:1788909221.771515:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11524:x1875807004861824:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788909221.771576:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788909221.771714:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11524:x1875807004861824:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 200us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.771724:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 171 00000100:00100000:3.0:1788909221.775202:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909221.775421:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004861952 00000100:00100000:1.0:1788909221.775434:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004861952 00000100:00100000:1.0:1788909221.775511:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:1.0:1788909221.775524:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11524:x1875807004861952:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788909221.775630:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.775654:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.775669:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.775686:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.775693:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776373:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776420:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776431:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776440:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909221.776505:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788909221.776511:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909221.776531:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776552:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776560:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776568:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776576:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909221.776581:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776590:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776615:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:1.0:1788909221.776619:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909221.776625:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776632:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d61b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776646:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776653:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776660:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776665:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909221.776668:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776675:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776683:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff890520ac5000) 00010000:00010000:1.0:1788909221.776686:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909221.776690:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.776697:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.777085:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.777093:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.777099:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.777104:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909221.777107:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.777132:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.777141:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293800) 00010000:00010000:1.0:1788909221.777144:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909221.777147:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.777154:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909221.777349:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11524:x1875807004861952:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 1820us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909221.777362:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:0.0:1788909221.784928:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909221.785201:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004862208 00000100:00100000:1.0:1788909221.785218:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004862208 00000100:00100000:1.0:1788909221.785301:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:1.0:1788909221.785339:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11524:x1875807004862208:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909221.785385:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909221.785419:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44803 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.785571:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.785592:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.785608:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909221.785843:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788909221.786137:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.786147:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.786156:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.786165:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909221.786170:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.786181:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.786292:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293800) 00010000:00010000:1.0:1788909221.786303:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788909221.786676:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.786688:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d61cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.786753:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44803 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.786767:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:1.0:1788909221.786770:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788909221.786775:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d61c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44803 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.786786:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768200, rc 0) 00000100:00100000:1.0:1788909221.786878:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11524:x1875807004862208:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1552us (1968us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1788909221.786889:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 173 00000100:00100000:3.0:1788909221.790221:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.790323:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004862336 00000100:00100000:0.0:1788909221.790337:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004862336 00000100:00100000:0.0:1788909221.790416:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:0.0:1788909221.790428:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11524:x1875807004862336:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788909221.790480:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788909221.790713:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11524:x1875807004862336:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 285us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.790721:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:3.0:1788909221.796301:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.798600:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004862592 00000100:00100000:0.0:1788909221.798636:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004862592 00000100:00100000:0.0:1788909221.798738:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:0.0:1788909221.798751:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11524:x1875807004862592:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909221.798780:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909221.798784:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788909221.798821:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d6189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447f5 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.798847:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:0.0:1788909221.798853:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909221.798870:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d61dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4480a expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788909221.799523:0:7640:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788909221.799805:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d61e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.799822:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d61e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.799849:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d61e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.799920:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d61dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4480a expref: 60 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.799938:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d61e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4480a expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.799948:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293d00) 00010000:00010000:0.0:1788909221.799951:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909221.799954:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517000, rc 0) 00000100:00100000:0.0:1788909221.800051:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11524:x1875807004862592:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1302us (3761us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788909221.800061:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 175 00000100:00100000:1.0:1788909221.812016:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909221.812104:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004862848 00000100:00100000:2.0:1788909221.812160:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004862848 00000100:00100000:2.0:1788909221.812270:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:2.0:1788909221.812284:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11524:x1875807004862848:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788909221.812381:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909221.812419:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d61e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4480a expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812444:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293d00) 00010000:00010000:2.0:1788909221.812459:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909221.812493:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812615:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812646:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812672:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812680:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812686:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812797:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812806:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812813:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812820:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909221.812825:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812834:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812844:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909221.812847:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909221.812851:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812865:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d61f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812878:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812884:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812890:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812896:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909221.812899:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812906:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812913:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4cb29c3 (ffff890510293200) 00010000:00010000:2.0:1788909221.812916:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909221.812918:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909221.812924:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d61f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4cb29c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909221.813229:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11524:x1875807004862848:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 946us (1225us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788909221.813240:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:3.0:1788909221.820415:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.821060:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004862976 00000100:00100000:0.0:1788909221.821072:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004862976 00000100:00100000:0.0:1788909221.821354:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:0.0:1788909221.821368:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11524:x1875807004862976:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909221.821392:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909221.821423:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d6200 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44811 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.821467:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.821483:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.821506:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.821622:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516a00/0x733cfdd8721d6200 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44811 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.821644:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44811 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.821654:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:0.0:1788909221.821658:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788909221.821662:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516200, rc 0) 00000100:00100000:0.0:1788909221.821744:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11524:x1875807004862976:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 380us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.821751:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 177 00000100:00100000:0.0:1788909221.826063:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909221.826745:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004863232 00000100:00100000:1.0:1788909221.826756:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004863232 00000100:00100000:1.0:1788909221.826826:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 178 00000100:00100000:1.0:1788909221.826840:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11524:x1875807004863232:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788909221.826947:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.826966:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.826995:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788909221.827778:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788909221.827794:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303901683923ns, next at 304901679777ns, rc = 0 00000004:00010000:1.0:1788909221.827915:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc6fa219 reply state 000000009319d3c0 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909221.827927:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788909221.828048:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11524:x1875807004863232:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1209us (1993us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788909221.828057:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 178 00010000:00010000:1.0:1788909221.831343:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.831361:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.831369:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.831374:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909221.831380:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.831388:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.831410:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:1.0:1788909221.831414:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788909221.831429:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.831434:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d620e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909221.833774:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909221.833986:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004863360 00000100:00100000:3.0:1788909221.834001:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004863360 00000100:00100000:3.0:1788909221.834081:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:3.0:1788909221.834092:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11524:x1875807004863360:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788909221.834806:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909221.834836:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44818 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.835204:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44818 expref: 61 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.835223:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44818 expref: 61 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.835262:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:3.0:1788909221.835266:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788909221.835269:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6400, rc 0) 00000100:00100000:3.0:1788909221.835353:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11524:x1875807004863360:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1262us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909221.835361:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 179 00000100:00100000:1.0:1788909221.840096:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909221.840381:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004863488 00000100:00100000:3.0:1788909221.840391:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004863488 00000100:00100000:3.0:1788909221.840474:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:3.0:1788909221.840485:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004863488:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788909221.841003:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909221.841547:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2347:x1875807004863488:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 1059us (1464us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788909221.841557:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:3.0:1788909221.847796:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909221.848764:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004863744 00000100:00100000:2.0:1788909221.848778:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004863744 00000100:00100000:2.0:1788909221.848850:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1788909221.848861:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11524:x1875807004863744:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788909221.849376:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+62:11524:x1875807004863744:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 515us (1867us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788909221.849387:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1788909221.856872:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.857099:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004864000 00000100:00100000:0.0:1788909221.857132:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004864000 00000100:00100000:0.0:1788909221.857202:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:0.0:1788909221.857213:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+62:11524:x1875807004864000:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788909221.857324:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+62:11524:x1875807004864000:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.857331:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 180 00000100:00100000:3.0:1788909221.861477:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.861755:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004864128 00000100:00100000:0.0:1788909221.861766:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004864128 00000100:00100000:0.0:1788909221.861851:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:0.0:1788909221.861865:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+62:11524:x1875807004864128:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909221.861895:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909221.861925:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d621c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4481f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.862019:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6223 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.862040:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.862057:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909221.864843:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909221.864898:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.864942:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d621c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4481f expref: 64 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.864963:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6223 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4481f expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.864973:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:0.0:1788909221.864975:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788909221.864978:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516e00, rc 0) 00000100:00100000:0.0:1788909221.865066:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+63:11524:x1875807004864128:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 3204us (3599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.865089:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 181 00000100:00100000:2.0:1788909221.867953:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909221.868061:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004864256 00000100:00100000:3.0:1788909221.868074:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004864256 00000100:00100000:3.0:1788909221.869171:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1788909221.869196:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004864256:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788909221.869219:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909221.869248:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44826 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909221.869281:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa096a5, blocks: 0x1 00010000:00010000:3.0:1788909221.869311:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=303s v=(0 0) 00010000:00010000:3.0:1788909221.869316:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909221.869326:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44826 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.869345:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44826 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.869360:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6600, rc 0) 00000100:00100000:3.0:1788909221.869437:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004864256:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 255us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909221.869444:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1788909221.878773:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.879843:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004864512 00000100:00100000:0.0:1788909221.879855:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004864512 00000100:00100000:0.0:1788909221.879924:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:0.0:1788909221.879934:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+63:11524:x1875807004864512:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788909221.880080:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+63:11524:x1875807004864512:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 146us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.880089:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 182 00000100:00100000:2.0:1788909221.885538:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.885697:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004864640 00000100:00100000:0.0:1788909221.885709:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004864640 00000100:00100000:0.0:1788909221.885774:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:0.0:1788909221.885785:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:11524:x1875807004864640:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909221.885811:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909221.885832:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4482d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.885867:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44826 expref: 9 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.885876:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909221.886013:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909221.886022:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.886063:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44826 expref: 9 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.886084:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44826 expref: 9 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909221.886101:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6676:1875807019536256:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909221.886437:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502bf7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788909221.890666:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.890756:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6676:1875807019536256:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909221.890815:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909221.890840:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516600, rc 0) 00000100:00100000:1.0:1788909221.890902:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004864768 00000100:00100000:1.0:1788909221.890910:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004864768 00000100:00100000:0.0:1788909221.890939:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:11524:x1875807004864640:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 5154us (5411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.890974:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00010000:00010000:1.0:1788909221.891005:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44826 expref: 10 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909221.891158:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:1.0:1788909221.891218:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2349:x1875807004864768:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909221.891269:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909221.891327:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44826 expref: 9 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.891361:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44826 expref: 9 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.891402:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cf1250f/0x733cfdd8721d622a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44826 expref: 9 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.891416:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909221.891428:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909221.891438:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.891455:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909221.891495:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909221.891517:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905069cb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5809:1875807019536384:192.168.204.54@tcp:105: 00000100:00100000:1.0:1788909221.891590:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085a8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909221.897418:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909221.897568:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905069cb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5809:1875807019536384:192.168.204.54@tcp:105: 00010000:00010000:1.0:1788909221.897592:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909221.897652:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2349:x1875807004864768:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 6483us (6993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909221.897664:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:2.0:1788909221.897670:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004864896 00000100:00100000:2.0:1788909221.897678:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004864896 00002000:00100000:2.0:1788909221.897725:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff89040356d500 x1875807004864896/t0(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:152/0 lens 504/0 e 0 to 0 dl 1788909232 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788909221.897735:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89040356d500 with x1875807004864896 ext(0->8) 00002000:00010000:2.0:1788909221.897752:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89040356d500 00000100:00100000:2.0:1788909221.897777:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:2.0:1788909221.897787:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004864896:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788909221.898461:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:2350:x1875807004864896:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 674us (1051us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788909221.898471:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00002000:00100000:2.0:1788909221.898480:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff89040356d500 x1875807004864896/t4294967314(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:152/0 lens 504/448 e 0 to 0 dl 1788909232 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788909221.898489:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89040356d500 with x1875807004864896 ext(0->8) 00002000:00010000:2.0:1788909221.898492:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89040356d500 00000100:00100000:3.0:1788909221.901873:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909221.901925:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004865024 00000100:00100000:3.0:1788909221.901934:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004865024 00000100:00100000:3.0:1788909221.901985:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 183 00000100:00100000:3.0:1788909221.901996:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+63:11524:x1875807004865024:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788909221.945260:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+63:11524:x1875807004865024:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 43251us (43384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909221.945277:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 183 00000001:00080000:3.0:1788909221.945319:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:3.0:1788909221.945371:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788909221.945393:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8905090c9240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788909221.945398:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8905379dd500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890511848f00 00000020:00080000:3.0:1788909221.945408:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8905379dd000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890521f8d800 00000001:00080000:3.0:1788909221.945433:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1788909221.945437:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1788909221.945465:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1788909221.945657:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788909221.945839:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788909221.945916:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040356f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019536512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788909221.945984:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909221.946044:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909221.946051:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040356dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019536640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788909221.946077:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909221.946151:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019536512 00000100:00100000:3.0:1788909221.946159:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019536512 00000100:00100000:3.0:1788909221.946220:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019536640 00000100:00100000:3.0:1788909221.946223:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019536640 00000100:00100000:3.0:1788909221.946249:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788909221.946258:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875807019536512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788909221.946292:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788909221.946328:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa096a3, atime: 0x6aa096a3, ctime: 0x6aa096a3, blocks: 0x1 00010000:00010000:3.0:1788909221.946338:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.946360:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:3.0:1788909221.946365:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909221.946373:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.946403:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.946413:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.946420:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.946439:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788909221.946897:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3285:x1875807019536512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 638us (912us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788909221.946906:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788909221.946928:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788909221.946935:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019536640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788909221.947048:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788909221.947051:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788909221 00002000:00010000:3.0:1788909221.947053:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788909221.947055:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788909221 -> 1788909221 00002000:00010000:3.0:1788909221.947058:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788909221.947083:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875807019536640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (1006us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788909221.947091:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788909221.947144:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788909221.947148:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788909221.947178:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909221.947196:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.947206:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6e00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909221.947211:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.947222:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.947244:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.947251:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef0d89a0/0x733cfdd8721d6238 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909221.947268:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909221.947269:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909221.947271:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788909221.947308:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89040356dc00/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788909221.947314:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040356dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019536640:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788909221.947327:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89040356f100/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788909221.947333:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040356f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019536512:0@lo:6:osp-syn-1-0.0 00000040:00080000:0.0:1788909221.948383:0:12506:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788909221.948391:0:12506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788909221.948519:0:12506:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788909221.948533:0:12506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788909221.952718:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909221.953007:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004865152 00000100:00100000:0.0:1788909221.953018:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004865152 00000100:00100000:0.0:1788909221.953085:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1788909221.953097:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905069cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:2348:x1875807004865152:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788909221.976399:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909221.976451:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909221.976485:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909221.976528:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004865408 00000100:00100000:3.0:1788909221.976540:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004865408 00000100:00100000:3.0:1788909221.976612:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:3.0:1788909221.976624:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004865408:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909221.976715:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004865408:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909221.976723:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00080000:3.0:1788909221.976745:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909221.979237:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004865536 00000100:00100000:1.0:1788909221.979252:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004865536 00000100:00100000:0.0:1788909221.979428:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:0.0:1788909221.979517:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004865536:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909221.979611:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004865536:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 173us (3158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909221.979739:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00080000:1.0:1788909221.981252:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909221.983303:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004865280 00000100:00100000:3.0:1788909221.983322:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004865280 00000100:00100000:3.0:1788909221.983396:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 285 00000100:00100000:3.0:1788909221.983409:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004865280:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909221.983604:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004865280:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 196us (7215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909221.983614:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 285 00000001:00080000:0.0:1788909222.004634:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1788909222.004658:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788909222.004812:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905069cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2348:x1875807004865152:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 51710us (52094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909222.004824:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:1.0:1788909222.008237:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909222.008476:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004865792 00000100:00100000:3.0:1788909222.008487:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004865792 00000100:00080000:1.0:1788909222.008563:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909222.008583:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 184 00000100:00100000:3.0:1788909222.008596:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:11524:x1875807004865792:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788909222.008672:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909222.008716:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6223 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4481f expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.008751:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:3.0:1788909222.008758:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909222.008791:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.008805:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.008816:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788909222.009088:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008000f6fa reply state 000000006ff9a7eb transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909222.009098:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788909222.009256:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051175ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:11524:x1875807004865792:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 662us (1029us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788909222.009264:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 184 00010000:00010000:2.0:1788909222.012629:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.012656:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.012666:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.012673:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909222.012679:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.012687:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.012705:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:2.0:1788909222.012709:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909222.012713:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.012720:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6e00/0x733cfdd8721d623f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909222.014487:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909222.014782:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004865920 00000100:00100000:0.0:1788909222.014794:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004865920 00000100:00100000:0.0:1788909222.014855:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1788909222.014866:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2347:x1875807004865920:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788909222.015559:0:8092:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788909222.015564:0:8092:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788909221 -> 1788909220 00002000:00010000:0.0:1788909222.015567:0:8092:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788909219 00002000:00010000:0.0:1788909222.015569:0:8092:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788909221 -> 1788909220 00002000:00010000:0.0:1788909222.015571:0:8092:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788909222.015634:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2347:x1875807004865920:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 769us (1158us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788909222.015642:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:3.0:1788909222.023275:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909222.023284:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019536768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909222.023322:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004866176 00000100:00100000:3.0:1788909222.023333:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004866176 00000100:00100000:1.0:1788909222.023354:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909222.023400:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:3.0:1788909222.023414:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:11524:x1875807004866176:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00000100:00100000:1.0:1788909222.023437:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019536768 00000100:00100000:1.0:1788909222.023459:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019536768 00000100:00100000:1.0:1788909222.023497:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00010000:00010000:3.0:1788909222.023502:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909222.023505:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019536768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788909222.023528:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00010000:00010000:3.0:1788909222.023531:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44811 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.023557:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.023596:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44811 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.023616:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44811 expref: 18 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909222.023618:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019536768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909222.023637:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788909222.023641:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040356ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019536896:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909222.023712:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379796c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909222.023942:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788909222.023951:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89040356dc00, transno 4294967315 00000100:00100000:1.0:1788909222.023978:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019536768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909222.029770:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040356ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019536896:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909222.029810:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909222.035455:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909222.035617:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004866304 00000100:00100000:0.0:1788909222.035630:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004866304 00010000:00010000:0.0:1788909222.035808:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44811 expref: 19 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909222.035856:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:0.0:1788909222.035868:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:2350:x1875807004866304:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909222.035885:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909222.035892:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44811 expref: 19 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.035925:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44811 expref: 19 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.035950:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44811 expref: 19 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.035973:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:0.0:1788909222.035978:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.035989:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.035997:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.036035:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909222.036134:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909222.036143:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:2350:x1875807004866304:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 245us (666us total) trans 0 rc 0/0 00010000:00010000:2.0:1788909222.036148:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909222.036156:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00010000:00010000:2.0:1788909222.036320:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.036329:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.036348:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.036354:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909222.036359:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.036367:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.036378:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:2.0:1788909222.036382:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788909222.036387:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.036393:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6246 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909222.036677:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:11524:x1875807004866176:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 13265us (13411us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788909222.036688:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 185 00000100:00100000:3.0:1788909222.041241:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909222.041335:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004866432 00000100:00100000:0.0:1788909222.041490:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004866432 00000100:00100000:0.0:1788909222.041611:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:0.0:1788909222.041623:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004866432:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788909222.041682:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.041717:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.041726:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788909222.041731:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909222.041737:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.041776:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.041791:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 8 pid: 6676 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909222.041806:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6676:1875807019537024:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909222.041897:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053748c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788909222.047846:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909222.048174:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6676:1875807019537024:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909222.048224:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909222.048857:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004866560 00000100:00100000:2.0:1788909222.048867:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004866560 00010000:00010000:2.0:1788909222.048924:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 9 pid: 6676 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909222.048973:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:2.0:1788909222.048984:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2349:x1875807004866560:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909222.049017:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909222.049045:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 9 pid: 6676 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.049059:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 9 pid: 6676 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.049085:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000568ee3b7/0x733cfdd8721d6231 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a4482d expref: 9 pid: 6676 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.049269:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788909222.049275:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788909222.049282:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.049295:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.049332:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909222.049369:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.049383:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909222.049413:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2349:x1875807004866560:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 430us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909222.049423:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00010000:00010000:3.0:1788909222.049429:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.049439:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.049447:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.049455:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517e00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909222.049459:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.049468:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.049483:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.049491:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc50ff0e/0x733cfdd8721d624d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909222.049536:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004866432:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 7916us (8306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909222.049544:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788909222.057732:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909222.057813:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004866816 00000100:00100000:1.0:1788909222.057828:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004866816 00000100:00100000:1.0:1788909222.059451:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 186 00000100:00100000:1.0:1788909222.059470:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+17:11524:x1875807004866816:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788909222.059739:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.059759:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.059773:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.060046:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.060058:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44818 expref: 18 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.060080:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.060278:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44818 expref: 18 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.060296:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44818 expref: 18 pid: 7640 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909222.060313:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019537152:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909222.060459:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff890504e096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909222.064434:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909222.064533:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004866944 00000100:00100000:0.0:1788909222.064545:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004866944 00000100:00100000:1.0:1788909222.064594:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019537152:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909222.064594:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44818 expref: 19 pid: 7640 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.064632:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909222.064684:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1788909222.064696:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:2350:x1875807004866944:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909222.064714:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909222.064731:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44818 expref: 19 pid: 7640 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.064756:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44818 expref: 19 pid: 7640 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.064782:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6215 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44818 expref: 19 pid: 7640 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.064799:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:0.0:1788909222.064804:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.064814:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.064821:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.064851:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909222.064905:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:2350:x1875807004866944:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 212us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909222.064913:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00010000:00010000:1.0:1788909222.064977:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.064986:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788909222.065206:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788909222.065372:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788909222.065423:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788909222.065503:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7640:1875807019537280:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788909222.065566:0:7640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909222.065598:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909222.065614:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019537280 00000100:00100000:3.0:1788909222.065621:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019537280 00000100:00100000:3.0:1788909222.065665:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788909222.065674:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7640:x1875807019537280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788909222.065860:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7640:x1875807019537280:12345-0@lo:1000:mdt00_003.0 Request processed in 187us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909222.065868:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788909222.065908:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7640:1875807019537280:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788909222.066691:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788909222.067086:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040356fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7640:1875807019537408:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788909222.067199:0:7640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909222.067240:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905117f9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788909222.067531:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019537408 00000100:00100000:1.0:1788909222.067541:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019537408 00000100:00100000:1.0:1788909222.067601:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788909222.067612:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7640:x1875807019537408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788909222.067857:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7640:x1875807019537408:12345-0@lo:1000:mdt00_003.0 Request processed in 246us (657us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788909222.067865:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788909222.067928:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040356fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7640:1875807019537408:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788909222.067969:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.067979:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.067987:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.067994:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909222.067999:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068019:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068044:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890513293500) 00010000:00010000:3.0:1788909222.068047:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788909222.068052:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068058:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768000/0x733cfdd8721d625b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068091:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068098:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068104:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068362:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909222.068366:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068374:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068384:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293800) 00010000:00010000:3.0:1788909222.068386:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788909222.068389:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068395:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d6190 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068432:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068446:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a447fc expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068456:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068490:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447fc expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.068507:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447fc expref: 21 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909222.068521:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040356c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019537536:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909222.068606:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905117f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788909222.071404:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909222.071457:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040356c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019537536:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909222.071470:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004867072 00000100:00100000:0.0:1788909222.071479:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004867072 00010000:00010000:1.0:1788909222.071492:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.071528:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447fc expref: 22 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909222.071577:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:0.0:1788909222.071588:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:2349:x1875807004867072:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909222.071612:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909222.071621:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447fc expref: 22 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.071635:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447fc expref: 22 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.071661:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d61ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a447fc expref: 22 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.071677:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293800) 00010000:00010000:0.0:1788909222.071682:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.071693:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.071701:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909222.071731:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788909222.071758:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071767:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071779:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071785:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071791:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071797:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909222.071801:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071809:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071825:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293800) 00010000:00010000:1.0:1788909222.071828:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909222.071831:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071837:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6262 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071848:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071854:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071860:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071865:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909222.071868:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071873:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071880:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293800) 00010000:00010000:1.0:1788909222.071882:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788909222.071885:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909222.071891:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769600/0x733cfdd8721d6254 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909222.072157:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:11524:x1875807004866816:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 12693us (14438us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788909222.072167:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 186 00000020:00080000:1.0:1788909222.072171:0:7640:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788909222.073236:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788909222.073244:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788909222.073767:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788909222.073776:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788909222.073937:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:2349:x1875807004867072:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 2345us (2540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909222.073950:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:1.0:1788909222.080446:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909222.080548:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004867328 00000100:00100000:2.0:1788909222.080557:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004867328 00000100:00100000:2.0:1788909222.080616:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1788909222.080627:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:11524:x1875807004867328:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788909222.082343:0:5826:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788909222.082454:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788909222.082512:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.082529:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.082543:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.082551:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.082558:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.082565:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909222.082588:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788909222.082758:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:11524:x1875807004867328:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 2127us (2312us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788909222.082768:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000020:00080000:2.0:1788909222.082774:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788909222.083904:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909222.083921:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.083932:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909222.083937:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.083953:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.083969:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff890510293200) 00010000:00010000:3.0:1788909222.083972:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788909222.083977:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.083983:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6269 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909222.084006:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909222.084008:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909222.084010:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909222.597369:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909223.045597:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019537664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909223.045668:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909223.045880:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019537920:0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.045914:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909223.045935:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788909223.045941:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040356f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019537792:0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.045970:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909223.045990:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019538304:0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.046010:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909223.046038:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019537920 00000100:00100000:3.0:1788909223.046045:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019537920 00000100:00100000:3.0:1788909223.046084:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019538304 00000100:00100000:3.0:1788909223.046087:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019538304 00000100:00100000:3.0:1788909223.046151:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788909223.046162:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019537920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.046233:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019537920:12345-0@lo:400:kworker.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909223.046248:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788909223.046265:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788909223.046270:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019538304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.046297:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019538304:12345-0@lo:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909223.046303:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1788909223.046320:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909223.046332:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019538048:0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.046358:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909223.046377:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788909223.046382:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019538176:0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.046405:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909223.046460:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019538304:0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.046469:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019537920:0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.046491:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019538048 00000100:00100000:3.0:1788909223.046494:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019538048 00000100:00100000:3.0:1788909223.046519:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788909223.046524:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019538048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909223.046556:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019538048:12345-0@lo:400:kworker.0 Request processed in 32us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909223.046562:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1788909223.046575:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909223.046591:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019538048:0@lo:400:kworker.0 00000100:00100000:0.0:1788909223.047992:0:11699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019537664 00000100:00100000:0.0:1788909223.048007:0:11699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019537664 00000100:00100000:0.0:1788909223.048088:0:11699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788909223.048100:0:11699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905379a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875807019537664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788909223.048186:0:11699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788909223.048272:0:11699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905379a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875807019537664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909223.048279:0:11699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788909223.048333:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019537664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909223.050878:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019537792 00000100:00100000:2.0:1788909223.050891:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019537792 00000100:00100000:2.0:1788909223.050966:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788909223.050976:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019537792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909223.051073:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de4f34ee-762f-480d-9428-329e99488659+19:3286:x1875807019537792:12345-0@lo:400:kworker.0 Request processed in 98us (5100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909223.051095:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788909223.051183:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019538176 00000100:00100000:2.0:1788909223.051187:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019538176 00000100:00100000:2.0:1788909223.051218:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788909223.051225:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019538176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909223.051279:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019538176:12345-0@lo:400:kworker.0 Request processed in 54us (4873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909223.051285:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788909223.051581:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019538176:0@lo:400:kworker.0 00000100:00080000:3.0:1788909223.052198:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788909223.052210:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909223.052894:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040356f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de4f34ee-762f-480d-9428-329e99488659:3286:1875807019537792:0@lo:400:kworker.0 00000001:00080000:1.0:1788909223.131944:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788909223.131969:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:1.0:1788909223.621609:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788909223.857380:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909223.857390:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909223.857437:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788909223.857444:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788909223.949252:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909223.949341:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004867584 00000100:00100000:3.0:1788909223.949356:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004867584 00000100:00100000:3.0:1788909223.949439:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:3.0:1788909223.949452:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:11542:x1875807004867584:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909223.949485:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909223.949510:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d6270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44834 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909223.949831:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7e00/0x733cfdd8721d6277 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909223.949846:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7e00/0x733cfdd8721d6277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909223.949860:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7e00/0x733cfdd8721d6277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909223.949871:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1788909223.950047:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d6270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44834 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909223.950067:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7e00/0x733cfdd8721d6277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44834 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909223.950077:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:3.0:1788909223.950080:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788909223.950084:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7e00, rc 0) 00000100:00100000:3.0:1788909223.950232:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11542:x1875807004867584:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 782us (995us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788909223.950250:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 187 00000100:00100000:3.0:1788909223.956768:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909223.956848:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004867712 00000100:00100000:2.0:1788909223.956858:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004867712 00000100:00100000:2.0:1788909223.956948:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:2.0:1788909223.956959:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11542:x1875807004867712:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788909223.957037:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957054:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957066:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957083:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957104:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957137:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957456:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957465:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957471:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909223.957512:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957525:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957531:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957539:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957659:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909223.957664:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957672:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957692:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909223.957695:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909223.957701:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957707:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6285 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957722:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957729:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957734:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957739:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909223.957742:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957748:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957754:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293600) 00010000:00010000:2.0:1788909223.957756:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909223.957758:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957763:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d628c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957787:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957793:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957798:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957803:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909223.957806:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957812:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957819:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890510293500) 00010000:00010000:2.0:1788909223.957821:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909223.957824:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909223.957830:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909223.957957:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11542:x1875807004867712:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 998us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909223.957966:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 188 00000100:00100000:2.0:1788909224.013449:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.014663:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004867968 00000100:00100000:0.0:1788909224.014676:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004867968 00000100:00100000:0.0:1788909224.014744:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00100000:0.0:1788909224.014756:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11545:x1875807004867968:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909224.014778:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909224.014800:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d629a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4483b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.014961:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.014976:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.014990:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015009:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015016:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015035:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015451:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015461:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015469:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909224.015480:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788909224.015595:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015604:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015611:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015617:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909224.015621:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015629:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015641:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:0.0:1788909224.015644:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909224.015657:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015663:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015676:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015682:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015689:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015694:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909224.015697:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015703:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015710:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890513293c00) 00010000:00010000:0.0:1788909224.015712:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909224.015716:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015721:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015773:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d629a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4483b expref: 27 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015804:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4483b expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.015812:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:0.0:1788909224.015814:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909224.015816:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517c00, rc 0) 00000100:00100000:0.0:1788909224.015911:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:11545:x1875807004867968:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1157us (2471us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788909224.015919:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 189 00000100:00080000:0.0:1788909224.015951:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909224.022343:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.022553:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004868096 00000100:00100000:3.0:1788909224.022565:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004868096 00000100:00100000:3.0:1788909224.022662:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:3.0:1788909224.022673:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:11545:x1875807004868096:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:3.0:1788909224.022765:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.022788:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.022803:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.022849:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.022857:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.022864:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.022870:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909224.022876:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.022883:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.022916:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:3.0:1788909224.022920:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788909224.022925:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.022932:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7200/0x733cfdd8721d62bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909224.023022:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cbf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:11545:x1875807004868096:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 351us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909224.023029:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 190 00000100:00100000:3.0:1788909224.028282:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.028323:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004868352 00000100:00100000:3.0:1788909224.028336:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004868352 00000100:00100000:3.0:1788909224.028391:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1788909224.028405:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:11545:x1875807004868352:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788909224.029998:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:11545:x1875807004868352:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 1588us (1721us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788909224.030009:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:2.0:1788909224.070780:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.070886:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004868608 00000100:00100000:0.0:1788909224.070896:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004868608 00000100:00100000:0.0:1788909224.070963:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:0.0:1788909224.070974:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:11072:x1875807004868608:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788909224.071000:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909224.071026:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d62c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44842 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.071225:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.071241:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4483b expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.071249:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.071293:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4483b expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.071307:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4483b expref: 28 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.071322:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019538432:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909224.071500:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053748ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909224.073988:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019538432:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909224.074029:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.074421:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.074561:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004868736 00000100:00100000:3.0:1788909224.074568:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004868736 00010000:00010000:3.0:1788909224.074601:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4483b expref: 29 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909224.074643:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1788909224.074652:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:2350:x1875807004868736:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909224.074665:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909224.074681:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4483b expref: 29 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.074692:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4483b expref: 29 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.074711:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517c00/0x733cfdd8721d62af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4483b expref: 29 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.074726:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:3.0:1788909224.074731:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.074740:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.074746:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.074774:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909224.074841:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:2350:x1875807004868736:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 186us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909224.074851:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00010000:00010000:1.0:1788909224.074861:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.074877:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909224.074907:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788909224.075510:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d62c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44842 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.075561:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44842 expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.075573:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:0.0:1788909224.075578:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788909224.075582:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516c00, rc 0) 00000100:00100000:0.0:1788909224.075643:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:11072:x1875807004868608:12345-192.168.204.54@tcp:101:bash.0 Request processed in 4672us (4876us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788909224.075650:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 191 00000100:00100000:2.0:1788909224.080320:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.080899:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004868992 00000100:00100000:0.0:1788909224.080910:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004868992 00000100:00100000:0.0:1788909224.080997:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 192 00000100:00100000:0.0:1788909224.081011:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050937aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:11072:x1875807004868992:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:0.0:1788909224.081347:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.081366:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.081376:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788909224.081431:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788909224.081456:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008514aef reply state 00000000d05f972b transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.081464:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788909224.081511:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788909224.081627:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050937aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:11072:x1875807004868992:12345-192.168.204.54@tcp:36:bash.0 Request processed in 619us (1317us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788909224.081636:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 192 00000020:00080000:0.0:1788909224.081642:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788909224.084995:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.085027:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.085036:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.085042:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909224.085071:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.085081:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.085103:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:1.0:1788909224.085279:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909224.085287:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.085296:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517600/0x733cfdd8721d62d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.085703:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.087623:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004869120 00000100:00100000:0.0:1788909224.087643:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004869120 00000100:00100000:0.0:1788909224.087729:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:0.0:1788909224.087740:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:11072:x1875807004869120:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788909224.087766:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909224.087790:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d62e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44849 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.087871:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d62e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44849 expref: 32 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.087905:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d62e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44849 expref: 32 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.087931:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:0.0:1788909224.087934:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909224.087939:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517800, rc 0) 00000100:00100000:0.0:1788909224.088016:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:11072:x1875807004869120:12345-192.168.204.54@tcp:101:bash.0 Request processed in 278us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909224.088023:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 193 00000100:00100000:2.0:1788909224.091440:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.091910:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004869248 00000100:00100000:3.0:1788909224.091924:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004869248 00000100:00100000:3.0:1788909224.092033:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00080000:0.0:1788909224.092046:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909224.092048:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:11072:x1875807004869248:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788909224.092080:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909224.092161:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44850 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909224.092340:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa096a4, atime: 0x6aa096a3, ctime: 0x6aa096a4, blocks: 0xb 00010000:00010000:3.0:1788909224.092370:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=306s v=(0 0) 00010000:00010000:3.0:1788909224.092377:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909224.092388:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44850 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.092410:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44850 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.092426:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7200, rc 0) 00000100:00100000:3.0:1788909224.092511:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:11072:x1875807004869248:12345-192.168.204.54@tcp:101:bash.0 Request processed in 467us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909224.092529:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:2.0:1788909224.096831:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.099158:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004869376 00000100:00100000:3.0:1788909224.099180:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004869376 00002000:00010000:2.0:1788909224.099395:0:6680:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788909224.099403:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89053c772680 with x1875807004869376 ext(0->18446744073709551615) 00002000:00010000:2.0:1788909224.099422:0:6680:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89053c772680. 00000100:00100000:2.0:1788909224.099555:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1788909224.099568:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2349:x1875807004869376:12345-192.168.204.54@tcp:10:bash.0 00002000:00010000:2.0:1788909224.099956:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788909224.099961:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788909220 -> 1788909223 00002000:00010000:2.0:1788909224.099964:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788909219 -> 1788909219 00002000:00010000:2.0:1788909224.099967:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788909220 -> 1788909223 00002000:00010000:2.0:1788909224.099970:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788909224.100071:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2349:x1875807004869376:12345-192.168.204.54@tcp:10:bash.0 Request processed in 504us (3259us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788909224.100081:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00002000:00010000:2.0:1788909224.100085:0:6680:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788909224.100088:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89053c772680 with x1875807004869376 ext(0->18446744073709551615) 00002000:00010000:2.0:1788909224.100093:0:6680:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89053c772680. 00000100:00100000:2.0:1788909224.179305:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.179911:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004869504 00000100:00100000:3.0:1788909224.179931:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004869504 00000100:00100000:3.0:1788909224.181191:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:2.0:1788909224.181352:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:11559:x1875807004869504:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788909224.181472:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.181518:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.181533:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.181554:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.181562:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.181569:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182033:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182044:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182052:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909224.182104:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182158:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182166:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182260:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182267:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.182272:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182281:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182296:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909224.182299:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.182303:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182309:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d62ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182325:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182332:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182338:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182344:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.182347:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182365:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182375:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293100) 00010000:00010000:2.0:1788909224.182377:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.182380:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182386:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d62f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182401:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182408:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182414:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182419:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.182422:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182428:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182435:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:2.0:1788909224.182438:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.182441:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.182456:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d62fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.182857:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:11559:x1875807004869504:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1647us (3572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909224.182870:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 194 00000100:00100000:3.0:1788909224.216309:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909224.218467:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004869760 00000100:00100000:2.0:1788909224.218490:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004869760 00000100:00100000:2.0:1788909224.218665:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:2.0:1788909224.218680:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+32:11562:x1875807004869760:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909224.218711:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909224.218741:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6303 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44857 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.218856:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.218874:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.218898:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.218918:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.218925:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.218955:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.221788:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.221821:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.221836:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909224.221851:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788909224.221994:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222003:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222010:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222017:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.222023:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222032:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222048:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909224.222052:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.222065:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222073:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d630a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222092:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222098:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222105:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222176:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.222180:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222187:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222196:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293100) 00010000:00010000:2.0:1788909224.222198:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.222201:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222207:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222279:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d6303 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44857 expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222312:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44857 expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.222321:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:2.0:1788909224.222323:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788909224.222326:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11000, rc 0) 00000100:00100000:2.0:1788909224.222432:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:11562:x1875807004869760:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 3754us (6137us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788909224.222442:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 195 00000100:00100000:3.0:1788909224.226536:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.226889:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004869888 00000100:00100000:0.0:1788909224.226904:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004869888 00000100:00100000:0.0:1788909224.226989:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:0.0:1788909224.227003:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:11562:x1875807004869888:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:0.0:1788909224.227104:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.227165:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44842 expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.227176:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.227223:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44842 expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.227240:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44842 expref: 34 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.227281:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019538560:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909224.227442:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053748c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788909224.233741:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909224.233792:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890403558380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019538560:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909224.233843:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909224.233853:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004870144 00000100:00100000:1.0:1788909224.233864:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004870144 00000100:00100000:1.0:1788909224.234003:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1788909224.234017:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:5589:x1875807004870144:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788909224.234672:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+36:5589:x1875807004870144:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 653us (944us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788909224.234682:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788909224.238604:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909224.238778:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004870272 00000100:00100000:1.0:1788909224.238794:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004870272 00010000:00010000:1.0:1788909224.238863:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44842 expref: 36 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909224.238924:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:1.0:1788909224.238938:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+36:2349:x1875807004870272:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909224.238962:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909224.238996:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44842 expref: 36 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.239014:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44842 expref: 36 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.239049:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d62cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44842 expref: 36 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.239077:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:1.0:1788909224.239082:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.239095:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.239105:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.239238:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909224.239393:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.239405:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.239456:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.239466:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.239473:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.239492:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.239498:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.239507:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.239519:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:2.0:1788909224.239522:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909224.239528:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.239534:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517000/0x733cfdd8721d6326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.239786:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:11562:x1875807004869888:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 12783us (13464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909224.239799:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 196 00000100:00100000:1.0:1788909224.239931:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:2349:x1875807004870272:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 995us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909224.239939:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:0.0:1788909224.244816:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.244964:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004870528 00000100:00100000:3.0:1788909224.244978:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004870528 00000100:00100000:3.0:1788909224.245096:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:3.0:1788909224.245159:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+34:11562:x1875807004870528:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788909224.245587:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:11562:x1875807004870528:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 478us (787us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788909224.245596:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1788909224.346833:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909224.347182:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004870784 00000100:00100000:2.0:1788909224.347198:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004870784 00000100:00100000:2.0:1788909224.347279:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:2.0:1788909224.347292:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+35:11573:x1875807004870784:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:2.0:1788909224.347332:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909224.347363:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d632d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4485e expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.347495:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.347542:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.347557:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.347578:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.347585:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.347591:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.348856:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.348880:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.348893:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909224.349094:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788909224.349309:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349319:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349327:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349353:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.349359:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349371:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349390:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909224.349394:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.349400:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349408:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d6334 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349428:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349434:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349441:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349447:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.349449:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349455:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349476:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293100) 00010000:00010000:2.0:1788909224.349479:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.349571:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349580:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d633b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349787:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d632d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4485e expref: 38 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349808:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4485e expref: 37 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.349817:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:2.0:1788909224.349819:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909224.349822:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11c00, rc 0) 00000100:00100000:2.0:1788909224.350248:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:11573:x1875807004870784:12345-192.168.204.54@tcp:101:cat.0 Request processed in 2954us (3430us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788909224.350260:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 197 00000100:00100000:2.0:1788909224.360427:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909224.360596:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004871040 00000100:00100000:1.0:1788909224.360613:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004871040 00000100:00100000:1.0:1788909224.360711:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:1.0:1788909224.360726:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:11573:x1875807004871040:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:1.0:1788909224.361539:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+38:11573:x1875807004871040:12345-192.168.204.54@tcp:35:cat.0 Request processed in 812us (1128us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788909224.361575:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:0.0:1788909224.382897:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909224.383023:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004871296 00000100:00100000:2.0:1788909224.383037:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004871296 00000100:00100000:2.0:1788909224.383129:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 198 00000100:00100000:2.0:1788909224.383153:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+38:11574:x1875807004871296:12345-192.168.204.54@tcp:36:rm.0 00010000:00010000:2.0:1788909224.383240:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788909224.383279:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d6342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4485e expref: 38 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.385350:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44857 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.385371:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d62e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44849 expref: 36 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.385383:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890513293400) 00010000:00010000:2.0:1788909224.385399:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909224.385436:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.385454:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.385467:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.385499:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.385508:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.385515:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.386376:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.386391:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.386410:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788909224.387732:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788909224.387747:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306461636810ns, next at 307461633800ns, rc = 0 00010000:00010000:2.0:1788909224.387849:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.387868:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.387880:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.387888:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.387895:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.387903:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.387940:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909224.387978:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.387985:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.387993:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388012:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.388018:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388029:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388047:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890510293500) 00010000:00010000:2.0:1788909224.388050:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788909224.388056:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388062:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d635e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388089:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388095:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388101:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388105:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.388152:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388159:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.388375:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909224.388386:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.388392:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909224.388396:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.388403:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.388413:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff890510293500) 00010000:00010000:0.0:1788909224.388415:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788909224.388419:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.388425:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6365 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.388447:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909224.388449:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909224.388451:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909224.388702:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909224.388706:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.388710:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.388717:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6350 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909224.388732:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec0f22f1 reply state 00000000e4c52b2b transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.388744:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788909224.388940:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+37:11574:x1875807004871296:12345-192.168.204.54@tcp:36:rm.0 Request processed in 5792us (6047us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788909224.388953:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 198 00010000:00010000:2.0:1788909224.392608:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.392638:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.392646:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.392653:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.392659:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.392668:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.392717:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293100) 00010000:00010000:2.0:1788909224.392721:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.392728:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.392736:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6357 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.421785:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909224.422297:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004871552 00000100:00100000:2.0:1788909224.422314:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004871552 00000100:00100000:2.0:1788909224.422447:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:2.0:1788909224.422459:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+36:11580:x1875807004871552:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909224.422504:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909224.422533:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d636c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.422721:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.422739:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.422768:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.422787:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.422795:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.422819:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788909224.424371:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788909224.424683:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.424699:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.424713:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.425045:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.425054:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.425067:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.425075:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.425082:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.425091:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.425178:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909224.425181:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.425210:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.425218:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6373 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909224.425242:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3d5df5d reply state 000000003724c8a0 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.425256:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788909224.425317:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d636c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44865 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.425337:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44865 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.425347:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890510293600) 00010000:00010000:2.0:1788909224.425350:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909224.425353:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11000, rc 0) 00000100:00100000:2.0:1788909224.425571:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+39:11580:x1875807004871552:12345-192.168.204.54@tcp:101:bash.0 Request processed in 3113us (3815us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788909224.425582:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 199 00000100:00100000:2.0:1788909224.430276:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:1.0:1788909224.430448:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.430466:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.430476:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.430483:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909224.430490:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.430500:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.430521:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293100) 00010000:00010000:1.0:1788909224.430524:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909224.430530:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.430536:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d637a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909224.430744:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004871680 00000100:00100000:3.0:1788909224.430768:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004871680 00000100:00080000:2.0:1788909224.430944:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788909224.431040:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:3.0:1788909224.431054:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2347:x1875807004871680:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:3.0:1788909224.431079:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909224.431105:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4486c expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909224.431191:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788909224.431224:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=306s v=(0 0) 00010000:00010000:3.0:1788909224.431230:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909224.431244:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4486c expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.431267:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4486c expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.431285:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6c00, rc 0) 00000100:00100000:3.0:1788909224.431387:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2347:x1875807004871680:12345-192.168.204.54@tcp:101:bash.0 Request processed in 336us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909224.431396:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1788909224.434963:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909224.437032:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004871808 00000100:00100000:1.0:1788909224.437057:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004871808 00000100:00100000:1.0:1788909224.437192:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:1.0:1788909224.437207:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:11580:x1875807004871808:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788909224.437248:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909224.437306:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44873 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.437361:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4486c expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.437371:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909224.437376:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909224.437382:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.437431:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4486c expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.437446:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4486c expref: 7 pid: 6673 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909224.437474:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6676:1875807019538688:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909224.437623:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff890504d72300 going to sleep for 11 seconds 00000100:00100000:1.0:1788909224.443882:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6676:1875807019538688:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788909224.443934:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.443965:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769c00, rc 0) 00000100:00100000:1.0:1788909224.444052:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:11580:x1875807004871808:12345-192.168.204.54@tcp:101:bash.0 Request processed in 6847us (9102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909224.444084:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:0.0:1788909224.454715:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.454944:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004871936 00000100:00100000:3.0:1788909224.454978:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004871936 00010000:00010000:3.0:1788909224.455045:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4486c expref: 7 pid: 6673 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909224.455101:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1788909224.455174:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004871936:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909224.455197:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909224.455300:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4486c expref: 7 pid: 6673 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.455319:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4486c expref: 7 pid: 6673 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.455355:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d638f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4486c expref: 7 pid: 6673 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.455385:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909224.455390:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909224.455401:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.455413:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.455467:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909224.455501:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1875807019538816:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788909224.455698:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537acd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788909224.465832:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1875807019538816:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788909224.465944:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909224.466105:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2349:x1875807004871936:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 10991us (11408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909224.466164:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1788909224.479005:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.479169:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004872192 00000100:00100000:3.0:1788909224.479185:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004872192 00000100:00100000:3.0:1788909224.479440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:3.0:1788909224.479453:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+38:11580:x1875807004872192:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:3.0:1788909224.479936:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+39:11580:x1875807004872192:12345-192.168.204.54@tcp:35:bash.0 Request processed in 484us (949us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788909224.479946:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00010000:00010000:3.0:1788909224.645393:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909224.657897:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.658213:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004872320 00000100:00100000:3.0:1788909224.658297:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004872320 00000100:00100000:3.0:1788909224.658376:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:3.0:1788909224.658388:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+39:11596:x1875807004872320:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909224.658519:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909224.658550:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d639d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4487a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.658720:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d63a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.658895:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d63a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.659009:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d63a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909224.659094:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1788909224.659098:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788909224.659163:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d63a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.659197:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d639d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4487a expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.659284:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d63a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4487a expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.659296:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:3.0:1788909224.659300:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788909224.659304:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7000, rc 0) 00000100:00100000:3.0:1788909224.659722:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+40:11596:x1875807004872320:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1336us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909224.659733:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 200 00000100:00100000:2.0:1788909224.666563:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.666754:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004872576 00000100:00100000:0.0:1788909224.666953:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004872576 00000100:00100000:0.0:1788909224.667084:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:0.0:1788909224.667097:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+40:11596:x1875807004872576:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909224.667185:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909224.667225:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d63ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44881 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.667370:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d63b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.667392:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d63b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.667609:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d63b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909224.667627:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788909224.668048:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d63ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44881 expref: 43 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.668071:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d63b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44881 expref: 42 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.668082:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890510293600) 00010000:00010000:0.0:1788909224.668085:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909224.668089:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516e00, rc 0) 00000100:00100000:0.0:1788909224.668240:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+42:11596:x1875807004872576:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1145us (1694us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788909224.668271:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 201 00000100:00100000:2.0:1788909224.673368:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.674580:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004872832 00000100:00100000:0.0:1788909224.674601:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004872832 00000100:00100000:0.0:1788909224.674696:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:0.0:1788909224.674712:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+42:11596:x1875807004872832:12345-192.168.204.54@tcp:101:lfs.0 00000100:00100000:2.0:1788909224.675793:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:0.0:1788909224.676030:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788909224.676037:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004872960 00000100:00100000:1.0:1788909224.676048:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004872960 00010000:00010000:0.0:1788909224.676072:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d63c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44888 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909224.676198:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788909224.676213:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c770700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+44:2350:x1875807004872960:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909224.676228:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909224.676271:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d63b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44881 expref: 44 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.676274:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d63c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.676302:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d63c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.676316:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890510293600) 00010000:00010000:0.0:1788909224.676317:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d63c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.676324:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1788909224.676335:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:1.0:1788909224.676436:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c770700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+44:2350:x1875807004872960:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 226us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909224.676445:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:0.0:1788909224.676520:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d63c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44888 expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.676536:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d63c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44888 expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.676543:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890510293600) 00010000:00010000:0.0:1788909224.676546:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788909224.676548:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516200, rc 0) 00000100:00100000:0.0:1788909224.676597:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+43:11596:x1875807004872832:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1889us (3246us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788909224.676605:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 202 00000100:00100000:2.0:1788909224.688853:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.694141:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004873088 00000100:00100000:3.0:1788909224.694172:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004873088 00000100:00100000:3.0:1788909224.694305:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788909224.694318:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+6:2348:x1875807004873088:12345-192.168.204.54@tcp:1:lfs.0 00010000:00010000:3.0:1788909224.694394:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.694455:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.694467:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909224.694473:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788909224.694479:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.694547:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.695374:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 6 pid: 6676 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909224.695398:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1875807019538944:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909224.695582:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537acd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788909224.704534:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1875807019538944:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909224.704813:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.704926:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909224.705309:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004873216 00000100:00100000:1.0:1788909224.705323:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004873216 00002000:00100000:1.0:1788909224.705398:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff89053c773800 x1875807004873216/t0(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:155/0 lens 504/0 e 0 to 0 dl 1788909235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788909224.705410:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89053c773800 with x1875807004873216 ext(0->8) 00010000:00010000:1.0:1788909224.705419:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 7 pid: 6676 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.705438:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 7 pid: 6676 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788909224.705472:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89053c773800 00000100:00100000:1.0:1788909224.705570:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788909224.705583:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004873216:12345-192.168.204.54@tcp:4:lfs.0 00000100:00100000:1.0:1788909224.706445:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2349:x1875807004873216:12345-192.168.204.54@tcp:4:lfs.0 Request processed in 856us (1512us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788909224.706457:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00002000:00100000:1.0:1788909224.706465:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff89053c773800 x1875807004873216/t4294967308(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:155/0 lens 504/448 e 0 to 0 dl 1788909235 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788909224.706475:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89053c773800 with x1875807004873216 ext(0->8) 00010000:00010000:1.0:1788909224.706489:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 9 pid: 6676 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.706507:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 9 pid: 6676 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788909224.706516:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff89053c773800 00000100:00100000:2.0:1788909224.710548:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.711340:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004873344 00000100:00100000:0.0:1788909224.711356:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004873344 00010000:00010000:0.0:1788909224.711421:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 9 pid: 6676 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.711478:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:0.0:1788909224.711489:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2350:x1875807004873344:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909224.711513:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788909224.711541:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788909224.711545:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788909223 00002000:00010000:0.0:1788909224.711548:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788909224 00002000:00010000:0.0:1788909224.711550:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788909223 00010000:00010000:0.0:1788909224.711568:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 9 pid: 6676 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.711586:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 9 pid: 6676 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.711619:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe5685ef/0x733cfdd8721d6396 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44873 expref: 9 pid: 6676 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.711639:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909224.711645:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909224.711651:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.711685:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.711972:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909224.712065:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c770a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004873344:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 575us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909224.712075:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00010000:00010000:2.0:1788909224.712962:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.713195:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.713238:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.713248:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.713257:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.713265:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6c00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909224.713271:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.713282:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.713304:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.713338:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092aec648/0x733cfdd8721d63d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.713775:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2348:x1875807004873088:12345-192.168.204.54@tcp:1:lfs.0 Request processed in 19455us (24940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909224.713787:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:2.0:1788909224.718977:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909224.719204:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004873600 00000100:00100000:1.0:1788909224.719227:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004873600 00000100:00100000:1.0:1788909224.719312:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788909224.719326:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+43:11596:x1875807004873600:12345-192.168.204.54@tcp:35:lfs.0 00000004:00010000:1.0:1788909224.719429:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d63c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44888 expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788909224.719805:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788909224.719876:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788909224.720407:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788909224.720481:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.720504:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44865 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.720513:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.720563:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44865 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.720583:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44865 expref: 47 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909224.720600:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875807019539072:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909224.720741:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff890504d72300 going to sleep for 11 seconds 00000100:00100000:2.0:1788909224.724447:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909224.724659:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875807019539072:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788909224.724700:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.725340:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004873728 00000100:00100000:0.0:1788909224.725355:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004873728 00010000:00010000:0.0:1788909224.725423:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44865 expref: 48 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.725483:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:0.0:1788909224.725496:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c771180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+48:2350:x1875807004873728:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909224.725521:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909224.725529:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44865 expref: 48 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.725542:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44865 expref: 48 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.725574:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44865 expref: 48 pid: 5822 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.725600:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890510293600) 00010000:00010000:0.0:1788909224.725630:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.725642:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.725650:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.725979:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909224.726106:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c771180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+47:2350:x1875807004873728:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 611us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909224.726195:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00010000:00010000:1.0:1788909224.726435:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.726445:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788909224.726664:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788909224.727511:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788909224.727669:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875807019539200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788909224.728085:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909224.728362:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905084c0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788909224.728602:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019539200 00000100:00100000:3.0:1788909224.728807:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019539200 00000100:00100000:3.0:1788909224.731168:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788909224.731201:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875807019539200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788909224.731417:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875807019539200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 224us (3323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909224.731427:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788909224.731520:0:5826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788909224.731528:0:5826:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788909224.731557:0:5826:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89040356f100, transno 4294967307 00000100:00100000:1.0:1788909224.731583:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875807019539200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788909224.732262:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788909224.732370:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d6f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875807019539328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788909224.732443:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909224.733607:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788909224.733672:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019539328 00000100:00100000:0.0:1788909224.733684:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019539328 00000100:00100000:0.0:1788909224.733821:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788909224.733897:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1875807019539328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788909224.734479:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5826:x1875807019539328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 646us (2033us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788909224.734491:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788909224.734661:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d6f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875807019539328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788909224.734905:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788909224.734977:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.734992:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.735002:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.735009:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909224.735015:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.735024:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.735070:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890510293600) 00010000:00010000:1.0:1788909224.735073:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788909224.735078:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.735086:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d63dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788909224.738223:0:5826:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788909224.742086:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788909224.742184:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306816072545ns, next at 307816066238ns, rc = 0 00000001:00080000:1.0:1788909224.742206:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788909224.742500:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890510293600) 00010000:00010000:1.0:1788909224.742507:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788909224.742522:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d63c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44888 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909224.742798:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:11596:x1875807004873600:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 23474us (23839us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788909224.742812:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000020:00080000:1.0:1788909224.742819:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788909224.753311:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.753524:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004873856 00000100:00100000:0.0:1788909224.753540:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004873856 00000100:00100000:0.0:1788909224.753754:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:0.0:1788909224.753769:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+50:11596:x1875807004873856:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909224.753804:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909224.753838:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d63e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4488f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.753944:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d63e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4488f expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.754069:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d63e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4488f expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.754101:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909224.754104:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909224.754152:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516600, rc 0) 00000100:00100000:0.0:1788909224.754251:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+51:11596:x1875807004873856:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 486us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909224.754260:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 203 00000100:00100000:0.0:1788909224.762296:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.764621:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004874112 00000100:00100000:3.0:1788909224.764642:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004874112 00000100:00100000:2.0:1788909224.764908:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1788909224.764922:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+51:11596:x1875807004874112:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:2.0:1788909224.769080:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:11596:x1875807004874112:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 4131us (6773us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788909224.769103:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:3.0:1788909224.843399:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909224.843645:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004874240 00000100:00100000:2.0:1788909224.843660:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004874240 00000100:00100000:2.0:1788909224.843751:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:2.0:1788909224.843764:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:11606:x1875807004874240:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:2.0:1788909224.843879:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.843902:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.843917:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.843956:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.843965:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.843973:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.844166:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.844177:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.844185:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788909224.845303:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845328:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845336:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845343:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845350:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909224.845354:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845362:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845378:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:3.0:1788909224.845382:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909224.845387:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845393:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11a00/0x733cfdd8721d63ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845432:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845438:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845443:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845448:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909224.845452:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845458:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845466:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890510293c00) 00010000:00010000:3.0:1788909224.845468:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909224.845472:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845477:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d63f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845492:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845498:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845505:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845515:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909224.845519:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845525:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845534:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909224.845536:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909224.845539:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.845546:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d63f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909224.845665:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:11606:x1875807004874240:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 1898us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909224.845675:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 204 00000100:00100000:2.0:1788909224.885092:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.885436:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004874496 00000100:00100000:0.0:1788909224.885451:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004874496 00000100:00100000:0.0:1788909224.885633:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:0.0:1788909224.885649:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+52:11609:x1875807004874496:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909224.885682:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909224.885714:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d63ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44896 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.885905:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.886218:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.886236:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.886281:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.886289:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.886297:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.886473:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.886483:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.886490:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909224.886502:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788909224.889064:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.889086:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.889094:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.889101:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909224.889613:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.889660:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.889684:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:0.0:1788909224.889687:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909224.889695:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.889702:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6406 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.889733:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.890440:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.890451:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.890456:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909224.890460:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.890467:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.890479:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890513293000) 00010000:00010000:0.0:1788909224.890482:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909224.890486:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.890506:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d640d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.890606:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d63ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44896 expref: 55 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.890626:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44896 expref: 54 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.890634:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909224.890637:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909224.890640:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516e00, rc 0) 00000100:00100000:0.0:1788909224.890765:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:11609:x1875807004874496:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 5118us (5690us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788909224.890775:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 205 00000100:00100000:0.0:1788909224.893917:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909224.895344:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004874624 00000100:00100000:2.0:1788909224.895366:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004874624 00000100:00100000:2.0:1788909224.895512:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:2.0:1788909224.895526:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:11609:x1875807004874624:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788909224.895628:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.895651:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.895667:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.895721:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.895730:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.895737:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.895744:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.895749:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.895758:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.895773:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909224.895776:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909224.895782:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.895789:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d6422 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.895918:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:11609:x1875807004874624:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 394us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909224.895927:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 206 00000100:00100000:3.0:1788909224.899912:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909224.904315:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004874880 00000100:00100000:1.0:1788909224.904340:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004874880 00000100:00100000:1.0:1788909224.904448:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1788909224.904715:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+54:11609:x1875807004874880:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788909224.905570:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:11609:x1875807004874880:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 1097us (5663us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788909224.905606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1788909224.973495:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.973619:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004875136 00000100:00100000:0.0:1788909224.973632:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004875136 00000100:00100000:0.0:1788909224.973710:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:0.0:1788909224.973724:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:11619:x1875807004875136:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788909224.973773:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909224.973777:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788909224.973819:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d63a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4487a expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.973856:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:0.0:1788909224.973882:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909224.973904:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6429 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4489d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.974049:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.974065:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44896 expref: 55 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.974074:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.974713:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44896 expref: 55 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.974791:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44896 expref: 55 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.974812:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d432680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019539456:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909224.979422:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053748c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909224.982366:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.982449:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004875264 00000100:00100000:3.0:1788909224.982461:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004875264 00010000:00010000:3.0:1788909224.982515:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44896 expref: 56 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909224.982564:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:3.0:1788909224.982576:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:2349:x1875807004875264:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909224.982594:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909224.982601:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44896 expref: 56 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.982632:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44896 expref: 56 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.982661:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909224.982668:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.982679:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.982688:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.982714:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788909224.983446:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44896 expref: 56 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909224.983473:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d432680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019539456:192.168.204.54@tcp:104: 00010000:00010000:1.0:1788909224.983499:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.983508:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.983512:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909224.983539:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:3.0:1788909224.983702:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+56:2349:x1875807004875264:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 247us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909224.983714:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00010000:00010000:1.0:1788909224.983881:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6429 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4489d expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.983900:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4489d expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909224.983910:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:1.0:1788909224.983913:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788909224.983917:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517a00, rc 0) 00000100:00100000:1.0:1788909224.983999:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:11619:x1875807004875136:12345-192.168.204.54@tcp:101:bash.0 Request processed in 10277us (10518us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788909224.984028:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 207 00000100:00100000:0.0:1788909224.986907:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909224.987045:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004875520 00000100:00100000:3.0:1788909224.987058:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004875520 00000100:00100000:3.0:1788909224.987280:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 208 00000100:00100000:3.0:1788909224.987295:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+55:11619:x1875807004875520:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:3.0:1788909224.987732:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.987775:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909224.987791:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788909224.987892:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788909224.987921:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ad889d2 reply state 0000000071a166b9 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909224.987931:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788909224.988062:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11619:x1875807004875520:12345-192.168.204.54@tcp:36:bash.0 Request processed in 769us (1172us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788909224.988070:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 208 00000020:00080000:3.0:1788909224.988076:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788909224.990012:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.990033:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.990058:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.990065:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909224.990072:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.990081:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.990103:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909224.990297:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909224.990304:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.990312:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6000/0x733cfdd8721d643e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.990459:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909224.990648:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004875648 00000100:00100000:2.0:1788909224.990660:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004875648 00000100:00100000:2.0:1788909224.990714:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:2.0:1788909224.990729:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11619:x1875807004875648:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909224.990760:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909224.990783:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6445 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448a4 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.990923:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.990940:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4489d expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.990964:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.991020:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4489d expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.991039:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4489d expref: 58 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909224.991059:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c773100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019539584:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909224.991291:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e90d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909224.994392:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909224.994523:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004875776 00000100:00100000:0.0:1788909224.994540:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004875776 00010000:00010000:0.0:1788909224.994604:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4489d expref: 59 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909224.994700:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:0.0:1788909224.994729:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:2350:x1875807004875776:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909224.994760:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788909224.994768:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c773100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1875807019539584:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909224.994772:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4489d expref: 59 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.994790:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4489d expref: 59 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.994806:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.994823:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6430 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a4489d expref: 59 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.994846:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909224.994852:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.994865:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.994875:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909224.994916:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909224.994981:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:2350:x1875807004875776:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 253us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909224.994990:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00010000:00010000:2.0:1788909224.996139:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.996154:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909224.996234:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788909224.996240:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909224.996268:0:7640:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.996316:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6445 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448a4 expref: 58 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.996362:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448a4 expref: 57 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909224.996372:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909224.996376:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909224.996379:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10a00, rc 0) 00000100:00100000:2.0:1788909224.996441:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11619:x1875807004875648:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5716us (5988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909224.996452:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 209 00000100:00100000:3.0:1788909225.001912:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.002249:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004876032 00000100:00100000:0.0:1788909225.002263:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004876032 00000100:00100000:0.0:1788909225.002534:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1788909225.002549:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+57:11619:x1875807004876032:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1788909225.002986:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11619:x1875807004876032:12345-192.168.204.54@tcp:35:bash.0 Request processed in 440us (1088us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788909225.002995:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:1.0:1788909225.047551:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.049613:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004876160 00000100:00100000:2.0:1788909225.049635:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004876160 00000100:00100000:2.0:1788909225.049852:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:2.0:1788909225.049865:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890504e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+58:11625:x1875807004876160:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909225.049895:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909225.049922:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448ab expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.050016:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d645a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.050035:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d645a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.050046:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d645a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909225.050163:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1788909225.050188:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909225.050223:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d645a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.050254:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d6453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ab expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.050278:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d645a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ab expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.050287:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909225.050290:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909225.050296:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909225.050401:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890504e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11625:x1875807004876160:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 538us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.050409:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 210 00000100:00100000:3.0:1788909225.057922:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.060763:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004876288 00000100:00100000:1.0:1788909225.060792:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004876288 00000100:00100000:1.0:1788909225.061006:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:1.0:1788909225.061020:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11625:x1875807004876288:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788909225.061050:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909225.061080:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448b2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.061817:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062040:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062056:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062078:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062086:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062092:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062338:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062368:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062376:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909225.062433:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788909225.062438:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909225.062464:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062480:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062490:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062498:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062506:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062513:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909225.062519:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062528:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062545:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:1.0:1788909225.062548:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909225.062561:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062568:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6468 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062589:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062597:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062603:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062609:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909225.062612:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062618:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062626:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890520ac5c00) 00010000:00010000:1.0:1788909225.062628:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909225.062631:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.062637:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d646f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.063698:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448b2 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.063755:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448b2 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.063766:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:1.0:1788909225.063769:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909225.063772:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769200, rc 0) 00000100:00100000:1.0:1788909225.063881:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11625:x1875807004876288:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 2863us (5974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909225.063892:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 211 00000100:00100000:0.0:1788909225.069349:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.069427:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.069549:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004876416 00000100:00100000:2.0:1788909225.069565:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004876416 00000100:00100000:2.0:1788909225.069684:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788909225.069698:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:2349:x1875807004876416:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909225.069721:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909225.069754:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448b2 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909225.071049:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004876672 00000100:00100000:3.0:1788909225.071063:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004876672 00000100:00100000:3.0:1788909225.071157:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:3.0:1788909225.071168:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11625:x1875807004876672:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909225.071194:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909225.071224:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7600/0x733cfdd8721d647d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448b9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.071380:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.071399:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448a4 expref: 62 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.071410:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.071493:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448a4 expref: 62 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.071514:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448a4 expref: 62 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909225.071531:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019539712:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909225.071687:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537acd000 going to sleep for 11 seconds 00010000:00010000:2.0:1788909225.072244:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909225.072252:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.072260:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.072281:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909225.072348:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:2349:x1875807004876416:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 2651us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.072622:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:3.0:1788909225.078091:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.078198:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019539712:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909225.078225:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004876800 00000100:00100000:1.0:1788909225.078238:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004876800 00010000:00010000:0.0:1788909225.078249:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.078301:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448a4 expref: 61 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909225.078352:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:1.0:1788909225.078364:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:2350:x1875807004876800:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909225.078385:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909225.078394:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448a4 expref: 61 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.078411:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448a4 expref: 61 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.078444:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10a00/0x733cfdd8721d644c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448a4 expref: 61 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.078498:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:1.0:1788909225.078505:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.078517:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.078527:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.078560:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909225.081748:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:2350:x1875807004876800:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3359us (3649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909225.081767:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00010000:00010000:0.0:1788909225.081820:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.081834:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909225.081864:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788909225.082099:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7600/0x733cfdd8721d647d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448b9 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.082159:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448b9 expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.082171:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909225.082174:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788909225.082181:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7c00, rc 0) 00000100:00100000:0.0:1788909225.082243:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11625:x1875807004876672:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 11077us (12814us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788909225.082252:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 212 00000100:00100000:3.0:1788909225.085549:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.085626:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004877056 00000100:00100000:2.0:1788909225.085642:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004877056 00000100:00100000:2.0:1788909225.085745:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788909225.085759:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11625:x1875807004877056:12345-192.168.204.54@tcp:103:lfs.0 00010000:00010000:2.0:1788909225.085781:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909225.085817:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516600/0x733cfdd8721d63e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4488f expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.085847:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909225.085853:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909225.085944:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11625:x1875807004877056:12345-192.168.204.54@tcp:103:lfs.0 Request processed in 189us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.085954:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1788909225.088031:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.088218:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004877184 00000100:00100000:2.0:1788909225.088240:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004877184 00000100:00100000:2.0:1788909225.088520:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:2.0:1788909225.088533:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11625:x1875807004877184:12345-192.168.204.54@tcp:58:lfs.0 00010000:00010000:2.0:1788909225.088702:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.088723:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.088747:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788909225.089506:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788909225.089635:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11625:x1875807004877184:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 1101us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.089647:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 213 00000100:00100000:3.0:1788909225.092053:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.092236:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004877312 00000100:00100000:0.0:1788909225.092251:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004877312 00000100:00100000:0.0:1788909225.092337:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 214 00000100:00100000:0.0:1788909225.092352:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+59:11625:x1875807004877312:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909225.092384:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909225.092416:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d6499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448c0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.092531:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.092546:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d6499 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c0 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.092585:0:5823:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.092606:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d6499 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c0 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.092627:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909225.092631:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909225.092635:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d6499 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c0 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.092643:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517200, rc 0) 00000100:00100000:0.0:1788909225.092731:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11625:x1875807004877312:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 383us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.092739:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 214 00000040:00080000:2.0:1788909225.157491:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909225.157502:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909225.157541:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:2.0:1788909225.157548:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788909225.157704:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019539840:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788909225.157841:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e90300 going to sleep for 11 seconds 00000100:00100000:2.0:1788909225.167698:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019539840:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788909225.168353:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.169703:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004877440 00000100:00100000:1.0:1788909225.169725:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004877440 00000100:00100000:1.0:1788909225.169989:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:1.0:1788909225.170020:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11627:x1875807004877440:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788909225.170060:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788909225.170314:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11627:x1875807004877440:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 313us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909225.170323:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 215 00000100:00100000:3.0:1788909225.179606:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.179906:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004877568 00000100:00100000:0.0:1788909225.179923:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004877568 00000100:00100000:0.0:1788909225.180016:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:0.0:1788909225.180030:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11627:x1875807004877568:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788909225.180401:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180423:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180439:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180459:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180467:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180474:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180507:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180517:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180524:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909225.180584:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788909225.180607:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909225.180627:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180642:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180649:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180657:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180663:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909225.180668:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180677:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180692:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:0.0:1788909225.180696:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909225.180702:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180708:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516000/0x733cfdd8721d64a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180730:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180814:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180895:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180900:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909225.180903:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180911:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180919:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff890513293000) 00010000:00010000:0.0:1788909225.180921:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909225.180925:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180931:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d64a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180952:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180959:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180966:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180971:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909225.180974:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180990:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.180999:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909225.181002:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909225.181005:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.181011:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516800/0x733cfdd8721d64ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909225.181424:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11627:x1875807004877568:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 1391us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.181436:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 216 00000100:00100000:3.0:1788909225.185374:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.185638:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004877824 00000100:00100000:1.0:1788909225.185656:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004877824 00000100:00100000:1.0:1788909225.185818:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:1.0:1788909225.185832:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+60:11627:x1875807004877824:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909225.185891:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909225.185918:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d64b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186034:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186050:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186062:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909225.186074:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788909225.186245:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186257:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186265:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186273:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909225.186278:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186299:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186313:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:1.0:1788909225.186325:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788909225.186332:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186337:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186385:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d64b5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c7 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186396:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:1.0:1788909225.186398:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788909225.186403:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d64b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c7 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.186412:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768600, rc 0) 00000100:00100000:1.0:1788909225.186488:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11627:x1875807004877824:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 659us (1385us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788909225.186496:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 217 00000100:00100000:3.0:1788909225.191732:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.192374:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004877952 00000100:00100000:2.0:1788909225.192385:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004877952 00000100:00100000:2.0:1788909225.192460:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:2.0:1788909225.192472:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11627:x1875807004877952:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788909225.192513:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788909225.192642:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11627:x1875807004877952:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 171us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.192655:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 218 00000100:00100000:3.0:1788909225.196475:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.196576:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004878208 00000100:00100000:2.0:1788909225.196588:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004878208 00000100:00100000:2.0:1788909225.196716:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:2.0:1788909225.196730:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11627:x1875807004878208:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788909225.196776:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909225.196779:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788909225.196807:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d645a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ab expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.196828:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909225.196832:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909225.196846:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d64ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448ce expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788909225.197449:0:7640:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788909225.197734:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d64d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.197753:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d64d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.197764:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d64d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.197833:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10200/0x733cfdd8721d64ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ce expref: 63 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.197850:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d64d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ce expref: 62 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.197859:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890510293800) 00010000:00010000:2.0:1788909225.197862:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909225.197880:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11800, rc 0) 00000100:00100000:2.0:1788909225.198039:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+62:11627:x1875807004878208:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1312us (1763us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788909225.198050:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 219 00000100:00100000:3.0:1788909225.203314:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.203374:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004878464 00000100:00100000:2.0:1788909225.203385:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004878464 00000100:00100000:2.0:1788909225.203453:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:2.0:1788909225.203475:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+62:11627:x1875807004878464:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788909225.203558:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909225.203593:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11800/0x733cfdd8721d64d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ce expref: 62 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203618:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890510293800) 00010000:00010000:2.0:1788909225.203629:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909225.203666:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203681:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203691:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203763:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203771:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203778:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203883:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203891:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203897:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203904:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909225.203909:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203917:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203927:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909225.203930:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909225.203933:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203939:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d64df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203948:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203954:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203959:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203970:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909225.203973:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203979:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203987:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1d2fe8ad (ffff890510293c00) 00010000:00010000:2.0:1788909225.203990:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909225.203992:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.203998:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1d2fe8ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.204088:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11627:x1875807004878464:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 625us (787us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788909225.204096:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 220 00000100:00100000:3.0:1788909225.209230:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.209556:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004878592 00000100:00100000:1.0:1788909225.209569:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004878592 00000100:00100000:1.0:1788909225.209637:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:1.0:1788909225.209648:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+61:11627:x1875807004878592:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909225.209674:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909225.209701:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d64ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.209739:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.209770:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.209784:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.209891:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d64ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448d5 expref: 63 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.209909:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448d5 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.209918:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:1.0:1788909225.209921:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788909225.209924:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769800, rc 0) 00000100:00100000:1.0:1788909225.210042:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+62:11627:x1875807004878592:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 395us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909225.210057:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 221 00000100:00100000:3.0:1788909225.216382:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.217516:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004878848 00000100:00100000:2.0:1788909225.217782:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004878848 00000100:00100000:2.0:1788909225.217963:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:2.0:1788909225.217975:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+62:11627:x1875807004878848:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788909225.218392:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.218415:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.218430:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788909225.218878:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1788909225.218972:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b1290a3 reply state 00000000fc5766ec transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.218980:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788909225.219266:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+64:11627:x1875807004878848:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1289us (2890us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788909225.219276:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 222 00000100:00100000:3.0:1788909225.226041:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.226260:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004878976 00010000:00010000:1.0:1788909225.226278:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.226286:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004878976 00010000:00010000:1.0:1788909225.226302:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.226313:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.226321:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909225.226328:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.226360:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.226388:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 223 00010000:00010000:1.0:1788909225.226400:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00000100:00100000:2.0:1788909225.226404:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89040356c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+64:11627:x1875807004878976:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909225.226408:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788909225.226422:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.226432:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10c00/0x733cfdd8721d64fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.226448:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909225.226479:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448dc expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.228236:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448dc expref: 64 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.228339:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448dc expref: 64 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.228367:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:2.0:1788909225.228371:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788909225.228375:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909225.228459:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89040356c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+64:11627:x1875807004878976:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2060us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.228488:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 223 00000100:00100000:3.0:1788909225.231366:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.231534:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004879104 00000100:00100000:0.0:1788909225.231547:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004879104 00000100:00100000:0.0:1788909225.231632:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1788909225.231645:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2350:x1875807004879104:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788909225.232152:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:2350:x1875807004879104:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 507us (801us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788909225.232162:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:3.0:1788909225.239352:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.239521:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004879360 00000100:00100000:1.0:1788909225.239538:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004879360 00000100:00100000:1.0:1788909225.239676:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:1.0:1788909225.239689:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+64:11627:x1875807004879360:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788909225.240172:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+65:11627:x1875807004879360:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 483us (834us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788909225.240183:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:3.0:1788909225.244814:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.245042:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004879616 00000100:00100000:0.0:1788909225.245059:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004879616 00000100:00100000:0.0:1788909225.245601:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:0.0:1788909225.245617:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+65:11627:x1875807004879616:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788909225.245830:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+65:11627:x1875807004879616:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 217us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.245855:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 224 00000100:00100000:3.0:1788909225.248602:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.248896:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004879744 00000100:00100000:1.0:1788909225.248921:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004879744 00000100:00100000:1.0:1788909225.249064:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:1.0:1788909225.249078:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+65:11627:x1875807004879744:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909225.249167:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909225.249211:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6509 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.249329:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.249368:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.249384:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909225.249439:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909225.249467:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.249512:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448e3 expref: 67 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.249535:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448e3 expref: 66 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.249545:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:1.0:1788909225.249549:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788909225.249553:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768400, rc 0) 00000100:00100000:1.0:1788909225.249755:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+66:11627:x1875807004879744:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 678us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909225.249764:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 225 00000100:00100000:3.0:1788909225.252444:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.252887:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004879872 00000100:00100000:0.0:1788909225.252903:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004879872 00000100:00100000:0.0:1788909225.253326:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1788909225.253341:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+10:2347:x1875807004879872:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909225.253367:0:8092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909225.253398:0:8092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448ea expref: -99 pid: 8092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788909225.253439:0:8092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa096a8, blocks: 0x1 00010000:00010000:0.0:1788909225.253467:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788909225.253472:0:8092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909225.253486:0:8092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ea expref: 11 pid: 8092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.253512:0:8092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ea expref: 11 pid: 8092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.253652:0:8092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516800, rc 0) 00000100:00100000:0.0:1788909225.253735:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:2347:x1875807004879872:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 396us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.253743:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1788909225.261680:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.261906:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004880128 00000100:00100000:2.0:1788909225.261922:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004880128 00000100:00100000:2.0:1788909225.262010:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:2.0:1788909225.262024:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+66:11627:x1875807004880128:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788909225.262534:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+66:11627:x1875807004880128:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 511us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.262545:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 226 00000100:00100000:3.0:1788909225.269368:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.269608:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004880256 00000100:00100000:0.0:1788909225.269622:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004880256 00000100:00100000:0.0:1788909225.269750:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:0.0:1788909225.269764:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:11627:x1875807004880256:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909225.269827:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909225.269861:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448f1 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.269918:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ea expref: 12 pid: 8092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.269928:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909225.269932:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909225.269939:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.269989:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448ea expref: 12 pid: 8092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.270006:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448ea expref: 12 pid: 8092 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909225.270025:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6675:1875807019539968:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909225.270318:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053748c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788909225.274227:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.275240:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6675:1875807019539968:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909225.275283:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.275310:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517800, rc 0) 00000100:00100000:0.0:1788909225.275399:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:11627:x1875807004880256:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 5638us (6048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.275409:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1788909225.278963:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004880384 00000100:00100000:2.0:1788909225.278984:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004880384 00010000:00010000:2.0:1788909225.279048:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448ea expref: 12 pid: 8092 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.279098:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:2.0:1788909225.279148:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:2350:x1875807004880384:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909225.279169:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909225.279203:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448ea expref: 12 pid: 8092 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.279220:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448ea expref: 12 pid: 8092 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.279245:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e88d53e/0x733cfdd8721d6517 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448ea expref: 12 pid: 8092 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.279293:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909225.279298:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909225.279310:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.279322:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.279365:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.279382:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1875807019540096:192.168.204.54@tcp:105: 00000100:00100000:2.0:1788909225.279494:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909225.285084:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.285348:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1875807019540096:192.168.204.54@tcp:105: 00010000:00010000:2.0:1788909225.285381:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909225.285447:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:2350:x1875807004880384:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 6339us (11234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.285460:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:0.0:1788909225.285887:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004880512 00000100:00100000:0.0:1788909225.285897:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004880512 00002000:00100000:0.0:1788909225.285959:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff89052e962680 x1875807004880512/t0(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:156/0 lens 504/0 e 0 to 0 dl 1788909236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788909225.285972:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89052e962680 with x1875807004880512 ext(0->12) 00002000:00010000:0.0:1788909225.285978:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89052e962680 00000100:00100000:0.0:1788909225.286013:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788909225.286023:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+11:2349:x1875807004880512:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788909225.286696:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:2349:x1875807004880512:12345-192.168.204.54@tcp:4:lhsmtool_posix.0 Request processed in 669us (1632us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788909225.286705:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00002000:00100000:0.0:1788909225.286713:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff89052e962680 x1875807004880512/t4294967320(0) o4->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:156/0 lens 504/448 e 0 to 0 dl 1788909236 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788909225.286722:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff89052e962680 with x1875807004880512 ext(0->12) 00002000:00010000:0.0:1788909225.286726:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89052e962680 00000100:00100000:3.0:1788909225.290361:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.290542:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004880640 00000100:00100000:2.0:1788909225.290554:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004880640 00000100:00100000:2.0:1788909225.290632:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 227 00000100:00100000:2.0:1788909225.290647:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+66:11627:x1875807004880640:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788909225.389184:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:3.0:1788909225.389225:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788909225.389241:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788909225.389265:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8905346c8f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788909225.389271:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890537ee5300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8905346c8d80 00000020:00080000:3.0:1788909225.389274:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890537ee5e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890508815c00 00000004:00080000:3.0:1788909225.389328:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788909225.389364:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890537979000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788909225.389368:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890537980200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8905379796c0 00000020:00080000:3.0:1788909225.389370:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890537980f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8905374ac000 00000020:00080000:3.0:1788909225.389381:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1788909225.389402:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:11627:x1875807004880640:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 98753us (99048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.389423:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 227 00000020:00080000:3.0:1788909225.389487:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788909225.389676:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788909225.389779:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052e961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019540352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788909225.389852:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909225.390077:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052e960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019540224:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788909225.390178:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019540352 00000100:00100000:2.0:1788909225.390186:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019540352 00000100:00100000:2.0:1788909225.390258:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788909225.390267:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019540352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788909225.390295:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788909225.390321:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.390343:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44850 expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.390352:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788909225.390356:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788909225.390360:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.390389:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44850 expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.390401:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44850 expref: 12 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.390414:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1875807019540480:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909225.391076:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909225.391305:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019540224 00000100:00100000:3.0:1788909225.391312:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019540224 00000100:00100000:3.0:1788909225.391352:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788909225.391359:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019540224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788909225.391377:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788909225.391408:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa096a7, atime: 0x6aa096a8, ctime: 0x6aa096a7, blocks: 0x1 00010000:00010000:3.0:1788909225.391425:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.391437:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1788909225.391441:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909225.391448:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.391463:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.391472:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.391480:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.391508:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788909225.392082:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1875807019540224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 721us (1006us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788909225.392091:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788909225.392272:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c0c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788909225.392289:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788909225.392294:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788909225.392724:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909225.392733:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.392758:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909225.392763:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.392772:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.392791:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.392798:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f284a00f/0x733cfdd8721d652c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.392820:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909225.392822:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909225.392824:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788909225.392906:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89052e960000/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788909225.392914:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052e960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019540224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788909225.396222:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.396573:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004880768 00000100:00100000:1.0:1788909225.396583:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004880768 00000100:00100000:1.0:1788909225.396645:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788909225.396656:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+13:2350:x1875807004880768:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788909225.410684:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.410725:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004880896 00000100:00100000:0.0:1788909225.410734:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004880896 00010000:00010000:0.0:1788909225.410779:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44850 expref: 14 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909225.410826:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:0.0:1788909225.410835:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2350:x1875807004880896:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909225.410851:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909225.410857:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44850 expref: 14 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.410872:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44850 expref: 14 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.410903:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909225.410908:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909225.410917:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.410927:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.410950:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909225.411009:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+14:2350:x1875807004880896:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 175us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.411017:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00010000:00010000:2.0:1788909225.411228:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000275c825a/0x733cfdd8721d62e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.54@tcp remote: 0xb281451763a44850 expref: 13 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.411259:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1875807019540480:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909225.411279:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.411290:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.411296:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.411306:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.411314:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.411334:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788909225.411943:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1875807019540352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21676us (22089us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788909225.411952:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1788909225.412004:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89052e961880/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788909225.412018:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052e961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019540352:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788909225.412284:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909225.412299:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.412308:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909225.412313:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.412322:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.412340:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.412346:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f44b1651/0x733cfdd8721d6525 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.412367:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909225.412368:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909225.412370:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909225.431846:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+12:2350:x1875807004880768:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 35182us (35623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.431860:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000001:00080000:2.0:1788909225.432570:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1788909225.432595:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:0.0:1788909225.437553:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909225.437646:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004881152 00000100:00100000:3.0:1788909225.437657:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004881152 00000100:00100000:3.0:1788909225.437761:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:3.0:1788909225.437774:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:11627:x1875807004881152:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788909225.437835:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909225.437876:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448e3 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.437897:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:3.0:1788909225.437903:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909225.437942:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.437956:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.437965:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788909225.439420:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d49080ff reply state 00000000a210ca10 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909225.439443:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788909225.440490:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:11627:x1875807004881152:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 2707us (2933us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788909225.440513:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 228 00000100:00100000:3.0:1788909225.447101:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.448739:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004881280 00000100:00100000:1.0:1788909225.448756:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004881280 00000100:00100000:1.0:1788909225.448861:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788909225.448887:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004881280:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788909225.449186:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788909225.449204:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788909224 00002000:00010000:1.0:1788909225.449207:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788909224 00002000:00010000:1.0:1788909225.449209:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788909224 -> 1788909224 00002000:00010000:1.0:1788909225.449212:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788909225.449291:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2349:x1875807004881280:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 420us (2201us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788909225.449299:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00010000:00010000:2.0:1788909225.450023:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.450037:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.450046:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.450051:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909225.450056:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.450064:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.450080:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:2.0:1788909225.450083:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909225.450088:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.450094:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7400/0x733cfdd8721d6533 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909225.455912:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.456046:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004881536 00000100:00100000:1.0:1788909225.456057:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004881536 00000100:00100000:1.0:1788909225.456158:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:1.0:1788909225.456170:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:11627:x1875807004881536:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788909225.456250:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.456271:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448d5 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.456280:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.456324:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448d5 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.456340:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448d5 expref: 20 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909225.456358:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890537f6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019540608:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909225.456458:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905346c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788909225.459877:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909225.459975:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004881664 00000100:00100000:3.0:1788909225.459996:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004881664 00000100:00100000:1.0:1788909225.460049:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890537f6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875807019540608:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909225.460067:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448d5 expref: 21 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.460086:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.460243:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:2.0:1788909225.460262:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:2350:x1875807004881664:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909225.460282:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909225.460292:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448d5 expref: 21 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.460306:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448d5 expref: 21 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.460345:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d64f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448d5 expref: 21 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.460365:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:2.0:1788909225.460369:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.460380:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.460389:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.460421:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788909225.460500:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.460508:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.460539:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.460546:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.460553:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.460559:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909225.460563:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.460571:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.460580:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:1.0:1788909225.460583:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788909225.460586:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.460592:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768c00/0x733cfdd8721d653a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909225.460659:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:11627:x1875807004881536:12345-192.168.204.54@tcp:55:lhsmtool_posix.0 Request processed in 4492us (4759us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788909225.460669:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 229 00000100:00100000:2.0:1788909225.460731:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:2350:x1875807004881664:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 477us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.460739:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1788909225.465665:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.465733:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004881792 00000100:00100000:2.0:1788909225.465749:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004881792 00000100:00100000:2.0:1788909225.465822:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:2.0:1788909225.465834:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004881792:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788909225.465881:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.465903:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.465934:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909225.465939:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788909225.465943:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.465983:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.466000:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 8 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.466019:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1875807019540736:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909225.466161:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909225.471319:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1875807019540736:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909225.471348:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909225.474442:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.474569:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004881920 00000100:00100000:0.0:1788909225.474588:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004881920 00010000:00010000:0.0:1788909225.474650:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 9 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909225.474728:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:0.0:1788909225.474739:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+9:2350:x1875807004881920:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909225.474755:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909225.474776:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 9 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.474790:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 9 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.474815:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bce7b308/0x733cfdd8721d651e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a448f1 expref: 9 pid: 6675 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.474832:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909225.474836:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788909225.474842:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.474852:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.474884:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909225.474953:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004881920:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 215us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.474961:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00010000:00010000:2.0:1788909225.475103:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.475162:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.475189:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.475203:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.475212:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.475219:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909225.475224:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.475232:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.475250:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.475260:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9d4f7a3/0x733cfdd8721d6541 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.475328:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004881792:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 9496us (9677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.475336:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:3.0:1788909225.479538:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.479624:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004882176 00000100:00100000:2.0:1788909225.479642:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004882176 00000100:00100000:2.0:1788909225.479788:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 230 00000100:00100000:2.0:1788909225.479812:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:11627:x1875807004882176:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788909225.479895:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.479915:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.479926:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.482402:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.483952:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448dc expref: 20 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.483975:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.484106:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448dc expref: 20 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.484163:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448dc expref: 20 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.484180:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019540864:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909225.484278:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909225.491492:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.491754:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004882304 00000100:00100000:1.0:1788909225.491764:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004882304 00010000:00010000:1.0:1788909225.491809:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448dc expref: 21 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909225.491853:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1788909225.491863:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:2349:x1875807004882304:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909225.491877:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909225.491884:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448dc expref: 21 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.491899:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448dc expref: 21 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.491921:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:1.0:1788909225.491926:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.491935:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.491943:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.491961:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909225.492032:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:2349:x1875807004882304:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 169us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909225.492040:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00010000:00010000:2.0:1788909225.492323:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11e00/0x733cfdd8721d6502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448dc expref: 20 pid: 7640 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.492353:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019540864:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909225.492373:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.492382:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.492388:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788909225.492584:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788909225.492745:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788909225.492792:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788909225.492871:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875807019540992:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788909225.492916:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909225.492953:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788909225.492992:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019540992 00000100:00100000:3.0:1788909225.493007:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019540992 00000100:00100000:2.0:1788909225.493228:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788909225.493236:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1875807019540992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788909225.493299:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1875807019540992:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.493305:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788909225.493339:0:5823:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1788909225.493345:0:5823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1788909225.493368:0:5823:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff89052e961880 x1875807019540352/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788909241 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909225.493378:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875807019540992:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788909225.494320:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788909225.494390:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875807019541120:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788909225.494437:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909225.494522:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909225.496881:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019541120 00000100:00100000:0.0:1788909225.496902:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019541120 00000100:00100000:1.0:1788909225.497873:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788909225.497887:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1875807019541120:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788909225.498376:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5823:x1875807019541120:12345-0@lo:1000:mdt00_001.0 Request processed in 490us (3936us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788909225.498386:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909225.498478:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c770700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875807019541120:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788909225.498551:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498567:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498577:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498585:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909225.498590:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498599:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498621:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890520ac5c00) 00010000:00010000:3.0:1788909225.498625:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788909225.498632:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498639:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11c00/0x733cfdd8721d654f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498682:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498689:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498720:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498725:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909225.498741:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498748:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498757:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909225.498760:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788909225.498770:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d6499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c0 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498782:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d6499 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c0 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498793:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d6499 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c0 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.498856:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d6499 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c0 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909225.498874:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052e961f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019541248:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788909225.499052:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537acd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909225.508708:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.508921:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004882432 00000100:00100000:0.0:1788909225.508933:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004882432 00000100:00100000:0.0:1788909225.509010:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1788909225.509023:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11625:x1875807004882432:12345-192.168.204.54@tcp:49:lfs.0 00000100:00100000:0.0:1788909225.509258:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11625:x1875807004882432:12345-192.168.204.54@tcp:49:lfs.0 Request processed in 236us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.509269:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:3.0:1788909225.511765:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052e961f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875807019541248:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788909225.511861:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.511875:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11400/0x733cfdd8721d6492 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512193:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512212:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512226:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512240:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512246:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512253:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512261:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909225.512267:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512277:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512305:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909225.512309:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909225.512322:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512329:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6556 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512342:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512350:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512356:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512362:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909225.512365:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512372:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512382:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909225.512385:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788909225.512388:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.512395:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d6548 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.512432:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.512679:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004882688 00000100:00100000:0.0:1788909225.512690:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004882688 00000100:00100000:0.0:1788909225.512775:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 231 00000100:00100000:0.0:1788909225.512791:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11625:x1875807004882688:12345-192.168.204.54@tcp:58:lfs.0 00000100:00100000:2.0:1788909225.512865:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+24:11627:x1875807004882176:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 33052us (33339us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788909225.512879:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 230 00000020:00080000:2.0:1788909225.512886:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788909225.513023:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909225.513028:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788909225.513442:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788909225.513517:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:11625:x1875807004882688:12345-192.168.204.54@tcp:58:lfs.0 Request processed in 730us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.513526:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 231 00000040:00080000:2.0:1788909225.513565:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:2.0:1788909225.513576:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788909225.521959:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909225.522032:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004882944 00000100:00100000:0.0:1788909225.522054:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004882944 00000100:00100000:0.0:1788909225.522489:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1788909225.522505:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+23:11627:x1875807004882944:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788909225.528005:0:5825:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788909225.528763:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788909225.528857:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.528881:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.528908:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.528919:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.528926:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.528933:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.529044:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788909225.529303:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+25:11627:x1875807004882944:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 6781us (7336us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788909225.529320:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000020:00080000:0.0:1788909225.529330:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788909225.530208:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909225.530221:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.530233:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909225.530239:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.530251:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.530273:0:6689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff890513293800) 00010000:00010000:1.0:1788909225.530335:0:6689:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788909225.530344:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.530351:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d655d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909225.530380:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909225.530382:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909225.530399:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909225.548428:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909225.548557:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004883072 00000100:00100000:3.0:1788909225.548571:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004883072 00000100:00100000:3.0:1788909225.548745:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 232 00000100:00100000:3.0:1788909225.548779:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+25:11629:x1875807004883072:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909225.548819:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909225.548849:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6564 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448f8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.548959:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.548981:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.548998:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.549017:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.549024:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.549033:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.549487:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.549500:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448b9 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.549509:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.549566:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448b9 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909225.549584:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448b9 expref: 26 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909225.549600:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052e961f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019541376:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909225.549733:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537acd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788909225.552884:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909225.553071:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004883328 00000100:00100000:1.0:1788909225.553085:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004883328 00000100:00100000:1.0:1788909225.553231:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:1.0:1788909225.553246:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:5589:x1875807004883328:12345-192.168.204.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788909225.553632:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:5589:x1875807004883328:12345-192.168.204.54@tcp:35:ldlm_bl.0 Request processed in 389us (763us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788909225.553642:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:1.0:1788909225.555937:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909225.557045:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004883456 00000100:00100000:2.0:1788909225.557060:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004883456 00000100:00100000:0.0:1788909225.557081:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052e961f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875807019541376:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909225.557148:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.557169:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448b9 expref: 28 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909225.557211:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1788909225.557222:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:2350:x1875807004883456:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909225.557239:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909225.558145:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448b9 expref: 28 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.558169:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448b9 expref: 28 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.558209:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7c00/0x733cfdd8721d6484 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a448b9 expref: 28 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.558227:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909225.558232:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.558241:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.558249:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909225.558276:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909225.558508:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558517:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909225.558561:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788909225.558566:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909225.558586:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558615:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558626:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558633:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558639:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558645:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909225.558650:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558658:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558676:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:0.0:1788909225.558680:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909225.558685:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558691:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7000/0x733cfdd8721d656b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558702:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558708:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558721:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558726:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909225.558729:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558735:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558744:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff890507e13700) 00010000:00010000:0.0:1788909225.558746:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909225.558749:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558754:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7800/0x733cfdd8721d6572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558794:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6c00/0x733cfdd8721d6564 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448f8 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558807:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448f8 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909225.558827:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909225.558829:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788909225.558832:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6400, rc 0) 00000100:00100000:2.0:1788909225.560263:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+27:2350:x1875807004883456:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 3023us (4327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909225.560279:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:0.0:1788909225.560524:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:11629:x1875807004883072:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 11745us (12112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909225.560562:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 232 00010000:00010000:0.0:1788909225.669469:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788909226.254458:0:12611:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788909226.254471:0:12611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788909226.254525:0:12611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:0.0:1788909226.254531:0:12611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788909226.566772:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909226.566782:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909226.566840:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:2.0:1788909226.566850:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788909226.567002:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c770e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019541504:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788909226.567213:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788909226.575351:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c770e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875807019541504:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788909226.576217:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909226.576974:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004883584 00000100:00100000:1.0:1788909226.576985:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004883584 00000100:00100000:1.0:1788909226.577063:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00100000:1.0:1788909226.577073:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:11641:x1875807004883584:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788909226.577173:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788909226.577289:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:11641:x1875807004883584:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 217us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909226.577298:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 233 00000100:00080000:2.0:1788909226.577528:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909226.584044:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909226.586621:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004883840 00000100:00100000:2.0:1788909226.586644:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004883840 00000100:00100000:2.0:1788909226.586774:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:2.0:1788909226.586802:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+26:11641:x1875807004883840:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788909226.586830:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909226.586861:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6580 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a448ff expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909226.587003:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909226.587022:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909226.587039:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909226.587056:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788909226.587731:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11000/0x733cfdd8721d6580 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ff expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.587757:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ff expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.587767:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909226.587770:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788909226.587775:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10000, rc 0) 00000100:00100000:3.0:1788909226.587877:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:11641:x1875807004883840:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1079us (3851us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788909226.587886:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 234 00000100:00100000:3.0:1788909226.592576:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909226.593501:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004884224 00000100:00100000:1.0:1788909226.593518:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004884224 00000100:00100000:1.0:1788909226.593628:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:1.0:1788909226.593640:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052e960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:2350:x1875807004884224:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909226.593662:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909226.593696:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d6587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448ff expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909226.594616:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:1.0:1788909226.594776:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00000100:00100000:3.0:1788909226.594858:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004884096 00000100:00100000:3.0:1788909226.594869:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004884096 00000100:00100000:3.0:1788909226.594945:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 235 00000100:00100000:3.0:1788909226.594971:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:11641:x1875807004884096:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788909226.595062:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909226.595515:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909226.595604:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052e960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:2350:x1875807004884224:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1963us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909226.595616:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00010000:00010000:3.0:1788909226.596481:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.596504:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.596897:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.596906:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.596914:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.597077:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909226.597084:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.597092:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.597154:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:3.0:1788909226.597158:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788909226.597164:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909226.597171:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6595 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909226.597566:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:11641:x1875807004884096:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 2594us (2954us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788909226.597577:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 235 00000040:00080000:2.0:1788909226.598285:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909226.598296:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909226.598806:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:2.0:1788909226.598817:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788909226.610412:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909226.610521:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004884480 00000100:00100000:1.0:1788909226.610534:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004884480 00000100:00100000:1.0:1788909226.610613:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:1.0:1788909226.610625:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+28:11641:x1875807004884480:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788909226.611173:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:11641:x1875807004884480:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 548us (776us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788909226.611183:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00010000:00010000:3.0:1788909226.693417:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909227.098924:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909227.099000:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909227.099047:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909227.099074:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909227.099183:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909227.099242:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004884864 00000100:00100000:1.0:1788909227.099256:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004884864 00000100:00100000:1.0:1788909227.099352:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004884992 00000100:00100000:1.0:1788909227.099355:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004884992 00000100:00100000:1.0:1788909227.099388:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1788909227.099401:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004884864:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909227.099500:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004884864:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 102us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909227.099519:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1788909227.099542:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788909227.099548:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004884992:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909227.099579:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2349:x1875807004884992:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909227.099585:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788909227.099611:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004885120 00000100:00100000:1.0:1788909227.099614:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004885120 00000100:00100000:1.0:1788909227.099646:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:1.0:1788909227.099653:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004885120:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909227.099683:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:2349:x1875807004885120:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909227.099690:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:1.0:1788909227.099699:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004884736 00000100:00100000:1.0:1788909227.099702:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004884736 00000100:00100000:1.0:1788909227.099724:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:1.0:1788909227.099730:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:2349:x1875807004884736:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909227.099763:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:2349:x1875807004884736:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 33us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909227.099770:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00080000:2.0:1788909227.100922:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788909227.100932:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788909227.100935:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909227.101193:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004884608 00000100:00100000:3.0:1788909227.101203:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004884608 00000100:00100000:3.0:1788909227.101264:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 287 00000100:00100000:3.0:1788909227.101273:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004884608:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909227.101351:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2349:x1875807004884608:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 80us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909227.101359:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 287 00000004:00080000:1.0:1788909227.141520:0:7152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309215405795ns, next at 310215402916ns, rc = 0 00000100:00100000:3.0:1788909227.141692:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788909227.141729:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019541632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909227.141891:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909227.142056:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019541632 00000100:00100000:1.0:1788909227.142068:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019541632 00000100:00100000:1.0:1788909227.142206:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788909227.142224:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875807019541632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788909227.142281:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909227.142342:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875807019541632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909227.142350:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788909227.142413:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019541632:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788909227.142660:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788909227.719042:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788909228.122097:0:12662:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788909228.122329:0:12662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788909228.122398:0:12662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:2.0:1788909228.122404:0:12662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788909228.165558:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019542144:0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.165611:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019541760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909228.165620:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019542016:0@lo:400:kworker.0 00000100:00100000:3.0:1788909228.165701:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909228.165730:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909228.165828:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019542144 00000100:00100000:0.0:1788909228.165838:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019542272:0@lo:400:kworker.0 00000100:00100000:1.0:1788909228.165840:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019542144 00000100:00100000:1.0:1788909228.165923:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788909228.165936:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019542144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909228.166036:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019542144:12345-0@lo:400:kworker.0 Request processed in 96us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909228.166039:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909228.166053:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788909228.166103:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788909228.166152:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019541888:0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.166205:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909228.166310:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019542400:0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.166369:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019541760 00000100:00100000:0.0:1788909228.166378:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019541760 00000100:00100000:1.0:1788909228.166422:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909228.166481:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019542528:0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.166485:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788909228.166530:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788909228.166571:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788909228.166578:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909228.166591:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019542016 00000100:00100000:1.0:1788909228.166597:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019542016 00000100:00100000:1.0:1788909228.166629:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788909228.166637:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019542016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.166675:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875807019541760:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909228.166690:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875807019542016:12345-0@lo:400:kworker.0 Request processed in 50us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909228.166712:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00002000:00000024:0.0:1788909228.166732:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909228.166748:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019542272 00000100:00100000:1.0:1788909228.166755:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019542272 00000100:00100000:1.0:1788909228.166800:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019542528 00000100:00100000:0.0:1788909228.166806:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875807019541760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909228.166807:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019542528 00000100:00100000:0.0:1788909228.166819:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788909228.166838:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788909228.166850:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1875807019542272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909228.166894:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1875807019542272:12345-0@lo:400:kworker.0 Request processed in 49us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909228.166900:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788909228.166915:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788909228.166920:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1875807019542528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909228.166946:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1875807019542528:12345-0@lo:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909228.166952:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788909228.167246:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019541888 00000100:00100000:0.0:1788909228.167255:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019541888 00000100:00100000:0.0:1788909228.167329:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788909228.167337:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019541888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.167392:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019541888:12345-0@lo:400:kworker.0 Request processed in 57us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909228.167399:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788909228.167449:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909228.167514:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019542272:0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.167537:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019541760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909228.167569:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019541888:0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.167731:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875807019542016:0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.167741:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019542528:0@lo:400:kworker.0 00000100:00100000:0.0:1788909228.167771:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019542144:0@lo:400:kworker.0 00000100:00100000:1.0:1788909228.169054:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019542400 00000100:00100000:1.0:1788909228.171445:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019542400 00000100:00100000:1.0:1788909228.171745:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788909228.171757:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019542400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909228.171916:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875807019542400:12345-0@lo:400:kworker.0 Request processed in 161us (4465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909228.171925:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788909228.172005:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019542400:0@lo:400:kworker.0 00000100:00080000:1.0:1788909228.172041:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788909228.284544:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788909228.284574:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1788909228.284616:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1788909228.317806:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909228.317925:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004885376 00000100:00100000:3.0:1788909228.317941:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004885376 00000100:00100000:3.0:1788909228.318042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:3.0:1788909228.318055:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+29:11661:x1875807004885376:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788909228.318096:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909228.318153:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d659c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44906 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788909228.318161:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788909228.318467:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d65a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.318486:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d65a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.318503:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d65a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909228.318517:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788909228.318695:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d659c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44906 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.318718:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d65a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44906 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.318729:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:1.0:1788909228.318733:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788909228.318739:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768200, rc 0) 00000100:00100000:1.0:1788909228.318845:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:11661:x1875807004885376:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 792us (1058us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788909228.318854:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 236 00000100:00100000:0.0:1788909228.325077:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909228.325245:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004885504 00000100:00100000:1.0:1788909228.325258:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004885504 00000100:00100000:1.0:1788909228.325338:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:1.0:1788909228.325350:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:11661:x1875807004885504:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788909228.325501:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.325523:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.325538:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.325573:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.325581:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.325589:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.325597:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909228.325603:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.325612:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.325629:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:1.0:1788909228.325633:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788909228.325640:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.325711:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d65b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909228.325858:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+31:11661:x1875807004885504:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 508us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909228.325869:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 237 00000100:00100000:3.0:1788909228.425300:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909228.429495:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004885632 00000100:00100000:0.0:1788909228.429517:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004885632 00000100:00100000:1.0:1788909228.429964:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:1.0:1788909228.429979:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004885632:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1788909228.430008:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909228.430042:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044d52374/0x733cfdd8721d65b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4490d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788909228.430101:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa096a8, atime: 0x6aa096a8, ctime: 0x6aa096a8, blocks: 0xb 00010000:00010000:1.0:1788909228.430158:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=310s v=(0 0) 00010000:00010000:1.0:1788909228.430165:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909228.430179:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044d52374/0x733cfdd8721d65b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4490d expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.430205:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044d52374/0x733cfdd8721d65b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4490d expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909228.430225:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769400, rc 0) 00000100:00100000:1.0:1788909228.430331:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2350:x1875807004885632:12345-192.168.204.54@tcp:101:cat.0 Request processed in 355us (5047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909228.430340:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:1.0:1788909228.434613:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909228.437916:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004885760 00000100:00100000:2.0:1788909228.437941:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004885760 00002000:00100000:2.0:1788909228.438050:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8905342a7800 x1875807004885760/t0(0) o3->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:159/0 lens 488/0 e 0 to 0 dl 1788909239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788909228.438074:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8905342a7800 with x1875807004885760 ext(0->4095) 00002000:00010000:2.0:1788909228.438082:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8905342a7800 00000100:00100000:2.0:1788909228.438222:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788909228.438235:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2347:x1875807004885760:12345-192.168.204.54@tcp:3:cat.0 00000100:00100000:2.0:1788909228.441190:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+8:2347:x1875807004885760:12345-192.168.204.54@tcp:3:cat.0 Request processed in 2938us (6572us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788909228.441209:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00002000:00100000:2.0:1788909228.441225:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8905342a7800 x1875807004885760/t0(0) o3->9a693284-9812-4b47-95bb-9bc33a7c4ef4@192.168.204.54@tcp:159/0 lens 488/4536 e 0 to 0 dl 1788909239 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788909228.441237:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8905342a7800 with x1875807004885760 ext(0->4095) 00002000:00010000:2.0:1788909228.441244:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8905342a7800 00000040:00080000:0.0:1788909228.678763:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788909228.678780:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788909228.679324:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788909228.679335:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788909228.741551:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909229.767759:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788909230.783247:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788909230.783263:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00010000:00010000:0.0:1788909230.790189:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788909230.793102:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:3.0:1788909230.793143:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000004:00080000:3.0:1788909230.793150:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:3.0:1788909230.793172:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89050841c300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788909230.793177:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890502f99600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89050841c9c0 00000020:00080000:3.0:1788909230.793180:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff890502f99500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890508ff3c00 00000020:00080000:3.0:1788909230.793215:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788909230.793812:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788909230.794031:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788909230.794297:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909230.794318:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89040356fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019542656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788909230.794388:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909230.795593:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019542656 00000100:00100000:2.0:1788909230.795606:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019542656 00000100:00100000:0.0:1788909230.795789:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788909230.795802:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019542656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788909230.796436:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788909230.796442:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788909224 -> 1788909224 00002000:00010000:0.0:1788909230.796459:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788909224 -> 1788909224 00002000:00010000:0.0:1788909230.796461:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788909224 -> 1788909224 00002000:00010000:0.0:1788909230.796463:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788909230.796543:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1875807019542656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 744us (2154us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788909230.796552:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788909230.796602:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1788909230.796608:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89052e961880, transno 4294967321 00000004:00080000:0.0:1788909230.796631:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:0.0:1788909230.796652:0:3283:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff89040356fb80 x1875807019542656/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788909246 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788909230.796664:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89040356fb80/2, rc 0, transno 4294967324 00000100:00100000:0.0:1788909230.796670:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89040356fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019542656:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788909230.797152:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788909231.813599:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909232.224234:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909232.224279:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909232.224325:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909232.224351:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909232.224375:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909232.224406:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004885888 00000100:00100000:0.0:1788909232.224415:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004885888 00000100:00100000:0.0:1788909232.224468:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:0.0:1788909232.224478:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2350:x1875807004885888:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909232.224548:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2350:x1875807004885888:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 71us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909232.224556:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 289 00000100:00100000:0.0:1788909232.224615:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004886272 00000100:00100000:0.0:1788909232.224619:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004886272 00000100:00100000:0.0:1788909232.224665:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004886144 00000100:00100000:0.0:1788909232.224669:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004886144 00000100:00100000:0.0:1788909232.224693:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:0.0:1788909232.224701:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004886272:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909232.224732:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004886272:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909232.224739:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:0.0:1788909232.224752:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:0.0:1788909232.224759:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004886144:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909232.224787:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004886144:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909232.224793:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:0.0:1788909232.224813:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004886016 00000100:00100000:0.0:1788909232.224817:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004886016 00000100:00100000:0.0:1788909232.224859:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004886400 00000100:00100000:0.0:1788909232.224863:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004886400 00000100:00100000:0.0:1788909232.225030:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:0.0:1788909232.225038:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:2350:x1875807004886016:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909232.225072:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:2350:x1875807004886016:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909232.225078:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:0.0:1788909232.225090:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:0.0:1788909232.225097:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004886400:12345-192.168.204.54@tcp:400:kworker.0 00000100:00080000:1.0:1788909232.225560:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788909232.225566:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788909232.225569:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788909232.226845:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+5:2350:x1875807004886400:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1733us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909232.226871:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:2.0:1788909232.262153:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788909232.262299:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019542784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788909232.262408:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909232.262548:0:11699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019542784 00000100:00100000:3.0:1788909232.262560:0:11699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019542784 00000100:00100000:3.0:1788909232.262785:0:11699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788909232.262798:0:11699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890403558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019542784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909232.262847:0:11699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909232.262913:0:11699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890403558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019542784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909232.262920:0:11699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788909232.263024:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019542784:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788909232.263425:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909232.407972:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909232.408043:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004886528 00000100:00100000:0.0:1788909232.408058:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004886528 00000100:00100000:0.0:1788909232.408170:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:0.0:1788909232.408183:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:11306:x1875807004886528:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788909232.408342:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:11306:x1875807004886528:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 161us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909232.408350:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 238 00000100:00100000:2.0:1788909232.411283:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909232.411339:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004886784 00000100:00100000:2.0:1788909232.411352:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004886784 00000100:00100000:2.0:1788909232.411550:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:2.0:1788909232.412106:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:11306:x1875807004886784:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788909232.413837:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:11306:x1875807004886784:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 2259us (2569us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788909232.413854:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788909232.562039:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909232.562252:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004886912 00000100:00100000:2.0:1788909232.562268:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004886912 00000100:00100000:2.0:1788909232.562361:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 239 00000100:00100000:2.0:1788909232.562377:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+5:12112:x1875807004886912:12345-192.168.204.54@tcp:101:lsof.0 00010000:00010000:2.0:1788909232.562407:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909232.562441:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d65bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44914 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909232.562552:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d65c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909232.562573:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d65c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909232.562594:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d65c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909232.563403:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788909232.563413:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909232.563521:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d65c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909232.563564:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10000/0x733cfdd8721d65bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44914 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909232.563589:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d65c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44914 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909232.563610:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5a00) 00010000:00010000:2.0:1788909232.563614:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909232.563618:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11200, rc 0) 00000100:00100000:2.0:1788909232.563731:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae3d4805-3977-4f79-88af-684dce002b2f+6:12112:x1875807004886912:12345-192.168.204.54@tcp:101:lsof.0 Request processed in 1358us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909232.563741:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 239 00010000:00010000:1.0:1788909232.837446:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909233.285506:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019542912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909233.285607:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909233.285986:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019543168:0@lo:400:kworker.0 00000100:00100000:1.0:1788909233.286368:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019543296:0@lo:400:kworker.0 00000100:00100000:1.0:1788909233.286433:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909233.286505:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019542912 00000100:00100000:1.0:1788909233.286518:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019542912 00000100:00100000:1.0:1788909233.286606:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788909233.286618:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019542912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909233.286677:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909233.286902:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019543040:0@lo:400:kworker.0 00000100:00100000:2.0:1788909233.286954:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788909233.287650:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909233.287674:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019543040 00000100:00100000:2.0:1788909233.287682:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019543040 00000100:00100000:2.0:1788909233.287736:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788909233.287747:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019543040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909233.287806:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3283:x1875807019543040:12345-0@lo:400:kworker.0 Request processed in 60us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909233.287815:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788909233.289322:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019543296 00000100:00100000:0.0:1788909233.289339:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019543296 00000100:00100000:3.0:1788909233.289569:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019543424:0@lo:400:kworker.0 00000100:00100000:1.0:1788909233.289610:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019542912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2986us (3995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909233.289625:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788909233.289657:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909233.289731:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788909233.289737:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788909233.289760:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89052e960000, transno 4294967310 00000100:00100000:3.0:1788909233.289808:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019542912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909233.289841:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019543552:0@lo:400:kworker.0 00000100:00100000:0.0:1788909233.289857:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788909233.289876:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019543424 00000100:00100000:0.0:1788909233.289877:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019543296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909233.289881:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019543424 00000100:00100000:3.0:1788909233.289926:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788909233.289935:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019543424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909233.289979:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019543296:12345-0@lo:400:kworker.0 Request processed in 101us (3536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909233.289989:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788909233.290033:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019543424:12345-0@lo:400:kworker.0 Request processed in 99us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909233.290042:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788909233.290057:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019543296:0@lo:400:kworker.0 00000100:00100000:1.0:1788909233.290104:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909233.290188:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019543040:0@lo:400:kworker.0 00000100:00080000:2.0:1788909233.290241:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909233.290305:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019543424:0@lo:400:kworker.0 00000100:00100000:2.0:1788909233.290354:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019543552 00000100:00100000:2.0:1788909233.290360:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019543552 00000100:00100000:2.0:1788909233.290421:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788909233.290433:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019543552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909233.290525:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909233.290586:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019543552:0@lo:400:kworker.0 00000100:00100000:1.0:1788909233.290635:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019543168 00000100:00100000:1.0:1788909233.290639:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019543168 00000100:00100000:1.0:1788909233.290669:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788909233.290680:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019543168:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788909233.290764:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909233.290808:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019543168:12345-0@lo:400:kworker.0 Request processed in 129us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909233.290818:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788909233.290912:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019543168:0@lo:400:kworker.0 00000100:00100000:2.0:1788909233.291194:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019543552:12345-0@lo:400:kworker.0 Request processed in 661us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909233.291215:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00010000:1.0:1788909233.861390:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788909234.767773:0:12865:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:13:53 (1788909233) 00010000:00010000:1.0:1788909234.885286:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788909235.898890:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788909235.898914:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788909235.898945:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788909235.898953:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1788909235.908952:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1788909235.911347:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909236.933400:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909237.339069:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909237.339705:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004887040 00000100:00100000:1.0:1788909237.339719:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004887040 00000100:00100000:1.0:1788909237.339790:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 291 00000100:00100000:1.0:1788909237.339802:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2350:x1875807004887040:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909237.339908:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2350:x1875807004887040:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 107us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909237.339917:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 291 00000100:00100000:3.0:1788909237.343608:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909237.343649:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909237.343680:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909237.343696:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004887296 00000100:00100000:1.0:1788909237.343710:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004887296 00000100:00100000:3.0:1788909237.343716:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909237.343751:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004887424 00000100:00100000:3.0:1788909237.343756:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004887424 00000100:00100000:1.0:1788909237.343786:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1788909237.343798:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:1.0:1788909237.343800:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004887296:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909237.343811:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004887424:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909237.343881:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2350:x1875807004887296:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909237.343915:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00080000:1.0:1788909237.343936:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788909237.343939:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788909237.343992:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2350:x1875807004887424:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 185us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909237.343999:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:0.0:1788909237.344218:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004887552 00000100:00100000:0.0:1788909237.344223:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004887552 00000100:00100000:0.0:1788909237.344274:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004887168 00000100:00100000:0.0:1788909237.344283:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004887168 00000100:00100000:0.0:1788909237.344308:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:0.0:1788909237.344315:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae3d4805-3977-4f79-88af-684dce002b2f+6:2350:x1875807004887552:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909237.344350:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae3d4805-3977-4f79-88af-684dce002b2f+6:2350:x1875807004887552:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909237.344357:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 147 00000100:00100000:0.0:1788909237.344377:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:0.0:1788909237.344383:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:2350:x1875807004887168:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909237.344413:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:2350:x1875807004887168:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909237.344419:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00080000:1.0:1788909237.344537:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909237.381346:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909237.381375:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019543680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909237.381453:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909237.381576:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019543680 00000100:00100000:3.0:1788909237.381586:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019543680 00000100:00100000:3.0:1788909237.381652:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788909237.381662:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019543680:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788909237.381779:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788909237.381878:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909237.382234:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019543680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 572us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909237.382513:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788909237.382520:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89040356fb80, transno 4294967324 00000100:00100000:3.0:1788909237.382769:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788909237.383055:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019543680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788909237.957929:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909238.029023:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909238.029221:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004887808 00000100:00100000:2.0:1788909238.029236:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004887808 00000100:00100000:2.0:1788909238.029335:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1788909238.029347:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+18:12333:x1875807004887808:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:2.0:1788909238.030815:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:12333:x1875807004887808:12345-192.168.204.54@tcp:35:umount.0 Request processed in 1462us (1798us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788909238.030828:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1788909238.035223:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909238.035978:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004888064 00000100:00100000:1.0:1788909238.035995:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004888064 00000100:00100000:1.0:1788909238.036079:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788909238.036092:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+19:12333:x1875807004888064:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:1.0:1788909238.040017:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:12333:x1875807004888064:12345-192.168.204.54@tcp:35:umount.0 Request processed in 3908us (4790us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788909238.040032:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788909238.045389:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909238.045675:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004888320 00000100:00100000:2.0:1788909238.045689:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004888320 00000100:00100000:2.0:1788909238.046000:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:2.0:1788909238.046013:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905171c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+20:12333:x1875807004888320:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:2.0:1788909238.047341:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905171c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:12333:x1875807004888320:12345-192.168.204.54@tcp:35:umount.0 Request processed in 1320us (1955us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788909238.047355:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:3.0:1788909238.051190:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909238.051291:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004888576 00000100:00100000:1.0:1788909238.051305:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004888576 00000100:00100000:1.0:1788909238.051378:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:1.0:1788909238.051392:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:12333:x1875807004888576:12345-192.168.204.54@tcp:35:umount.0 00000100:00100000:1.0:1788909238.052400:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:12333:x1875807004888576:12345-192.168.204.54@tcp:35:umount.0 Request processed in 1004us (1220us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788909238.052438:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:3.0:1788909238.055480:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909238.055524:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909238.055650:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909238.055689:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909238.055734:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004889088 00000100:00100000:2.0:1788909238.055850:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004888704 00000100:00100000:1.0:1788909238.055850:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004888960 00000100:00100000:2.0:1788909238.055863:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004888704 00000100:00100000:1.0:1788909238.055863:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004888960 00000100:00100000:1.0:1788909238.055959:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004888832 00000100:00100000:1.0:1788909238.055964:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004888832 00000100:00100000:3.0:1788909238.056097:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004889088 00000100:00100000:3.0:1788909238.056170:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:3.0:1788909238.056182:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2346:x1875807004889088:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:3.0:1788909238.056221:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5916 00000100:00080000:3.0:1788909238.056231:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8905180b6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788909238.056278:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788909238.057098:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a693284-9812-4b47-95bb-9bc33a7c4ef4+2:2346:x1875807004889088:12345-192.168.204.54@tcp:9:umount.0 Request processed in 911us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909238.057137:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00010000:00010000:3.0:1788909238.057178:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909238.057808:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788909238.057827:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986c0547-f072-453e-bddd-5efe6ff9e6ca+15:2347:x1875807004888960:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909238.057847:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788909238.057885:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:2.0:1788909238.057890:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501692400/0x733cfdd8721d5828 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4456a expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909238.057903:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+15:2347:x1875807004888704:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909238.057924:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909238.057938:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501692a00/0x733cfdd8721d563e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4449f expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.057950:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909238.057952:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909238.057994:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+13:2347:x1875807004888704:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 99us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909238.058002:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788909238.058029:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788909238.058037:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+12:2347:x1875807004888832:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909238.058045:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909238.058056:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501534a00/0x733cfdd8721d55a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44467 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909238.058076:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909238.059792:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:2347:x1875807004888960:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1956us (4249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909238.059792:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:2347:x1875807004888832:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 1739us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909238.059815:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1788909238.059822:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788909238.061813:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909238.062075:0:8092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004889472 00000100:00100000:1.0:1788909238.062089:0:8092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004889472 00000100:00100000:1.0:1788909238.062210:0:8092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:1.0:1788909238.062222:0:8092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+7:2346:x1875807004889472:12345-192.168.204.54@tcp:9:umount.0 00000020:00000080:1.0:1788909238.062264:0:8092:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5b7e 00000020:00010000:1.0:1788909238.062274:0:8092:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8905180b6000: total 0 00000100:00080000:1.0:1788909238.062280:0:8092:0:(import.c:65:import_set_state_nolock()) ffff8905180b2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788909238.062531:0:8092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788909238.062943:0:8092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+5:2346:x1875807004889472:12345-192.168.204.54@tcp:9:umount.0 Request processed in 720us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909238.062955:0:8092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000020:00010000:0.0:1788909238.068357:0:6689:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8905180b6000: total 0 00010000:00010000:0.0:1788909238.068448:0:6689:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8905180b6000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788909238.068537:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef08855/0x733cfdd8721d5f1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4473f expref: 4 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909238.068586:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044d52374/0x733cfdd8721d65b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4490d expref: 3 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909238.068604:0:6689:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8905180b6000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788909238.068616:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909238.068619:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909238.068622:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909238.079349:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909238.081858:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004890496 00000100:00100000:0.0:1788909238.081956:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004890496 00000100:00100000:0.0:1788909238.082063:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 240 00000100:00100000:0.0:1788909238.082077:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+22:2346:x1875807004890496:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:0.0:1788909238.082395:0:7640:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d55b2 00000020:00010000:0.0:1788909238.082414:0:7640:0:(genops.c:1921:obd_stale_export_put()) Put export ffff890537882000: total 0 00000100:00080000:0.0:1788909238.082420:0:7640:0:(import.c:65:import_set_state_nolock()) ffff890537887800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788909238.082525:0:7640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788909238.083046:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a693284-9812-4b47-95bb-9bc33a7c4ef4+21:2346:x1875807004890496:12345-192.168.204.54@tcp:39:umount.0 Request processed in 969us (3709us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788909238.083076:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 240 00000020:00010000:2.0:1788909238.084233:0:8450:0:(genops.c:1907:obd_stale_export_get()) Get export ffff890537882000: total 0 00010000:00010000:2.0:1788909238.084306:0:8450:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff890537882000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788909238.084349:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:2.0:1788909238.084353:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788909238.084365:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10e00/0x733cfdd8721d58ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44594 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084389:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909238.084392:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788909238.084396:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517200/0x733cfdd8721d6499 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448c0 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084410:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909238.084412:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788909238.084417:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890500030000/0x733cfdd8721d5f98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44762 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084432:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:2.0:1788909238.084435:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788909238.084439:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890504d9d200/0x733cfdd8721d5dfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a446f2 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084453:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890520ac5700) 00010000:00010000:2.0:1788909238.084470:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909238.084475:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693800/0x733cfdd8721d5898 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4457f expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084497:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5a00) 00010000:00010000:2.0:1788909238.084500:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909238.084503:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768e00/0x733cfdd8721d5f7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4475b expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084515:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:2.0:1788909238.084517:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909238.084521:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9a00/0x733cfdd8721d5edb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4472a expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084534:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909238.084537:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909238.084540:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6400/0x733cfdd8721d6579 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a448f8 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084552:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909238.084554:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788909238.084557:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d65a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44906 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084572:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff890510293e00) 00010000:00010000:2.0:1788909238.084574:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788909238.084590:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890501693600/0x733cfdd8721d5bd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44666 expref: 11 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084621:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890510293900) 00010000:00010000:2.0:1788909238.084624:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909238.084628:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc10600/0x733cfdd8721d587c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44578 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084642:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff890520ac5800) 00010000:00010000:2.0:1788909238.084644:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788909238.084647:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89050bad9200/0x733cfdd8721d5f05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44738 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084661:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff890507e13800) 00010000:00010000:2.0:1788909238.084663:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788909238.084666:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7e00/0x733cfdd8721d6277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44834 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909238.084686:0:8450:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff890537882000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788909238.084704:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909238.084706:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909238.084708:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909238.405548:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019543808:0@lo:400:kworker.0 00000100:00100000:2.0:1788909238.405674:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019543936:0@lo:400:kworker.0 00000100:00100000:3.0:1788909238.405856:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019544192:0@lo:400:kworker.0 00000100:00100000:1.0:1788909238.405904:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019544064:0@lo:400:kworker.0 00000100:00100000:2.0:1788909238.407316:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909238.407396:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019544448:0@lo:400:kworker.0 00000100:00100000:2.0:1788909238.407430:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909238.407474:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788909238.407483:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019544320:0@lo:400:kworker.0 00000100:00100000:3.0:1788909238.407568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909238.407582:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909238.407669:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019544448 00000100:00100000:3.0:1788909238.407683:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019544448 00000100:00100000:2.0:1788909238.407727:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019543936 00000100:00100000:2.0:1788909238.407738:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019543936 00000100:00100000:3.0:1788909238.407774:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019544192 00000100:00100000:3.0:1788909238.407781:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019544192 00000100:00100000:2.0:1788909238.407801:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019544320 00000100:00100000:2.0:1788909238.407808:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019544320 00000100:00100000:3.0:1788909238.407823:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788909238.407837:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019544448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909238.407892:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788909238.407905:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019543936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909238.407980:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019544448:12345-0@lo:400:kworker.0 Request processed in 142us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909238.407992:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019543936:12345-0@lo:400:kworker.0 Request processed in 75us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909238.408002:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788909238.408021:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788909238.408050:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788909238.408056:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019544320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909238.408083:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875807019544320:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909238.408089:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788909238.408165:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875807019544320:0@lo:400:kworker.0 00000100:00100000:2.0:1788909238.408176:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019543936:0@lo:400:kworker.0 00000100:00100000:2.0:1788909238.408187:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019544448:0@lo:400:kworker.0 00000100:00100000:1.0:1788909238.411583:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909238.411667:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019544576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909238.411715:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788909238.411788:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788909238.411796:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909238.411816:0:11699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019544576 00000100:00100000:1.0:1788909238.411826:0:11699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019544576 00000100:00100000:1.0:1788909238.411906:0:11699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788909238.411916:0:11699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019544576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909238.411978:0:11699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909238.412470:0:11699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019544576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 553us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909238.412480:0:11699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788909238.412601:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788909238.412633:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019544192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909238.412703:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019544064 00000100:00100000:2.0:1788909238.412721:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019544064 00000100:00100000:1.0:1788909238.412764:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019544576:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788909238.412802:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909238.412814:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788909238.412827:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019544064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909238.413566:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019544064:12345-0@lo:400:kworker.0 Request processed in 739us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909238.413580:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788909238.414066:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019544064:0@lo:400:kworker.0 00000100:00100000:0.0:1788909238.417809:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909238.417881:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019543808 00000100:00100000:1.0:1788909238.417895:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019543808 00000100:00100000:1.0:1788909238.417970:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788909238.417982:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019543808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909238.418071:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019543808:12345-0@lo:400:kworker.0 Request processed in 92us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909238.418078:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788909238.418430:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019543808:0@lo:400:kworker.0 00000100:00100000:3.0:1788909238.419223:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019544192:12345-0@lo:400:kworker.0 Request processed in 6595us (11665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909238.419240:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788909238.419311:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019544192:0@lo:400:kworker.0 00000001:00100000:1.0:1788909238.465906:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:1.0:1788909238.465917:0:7643:0:(genops.c:885:class_export_put()) final put ffff8905180b2800/9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:3.0:1788909238.466005:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8905180b2800/9a693284-9812-4b47-95bb-9bc33a7c4ef4 for lustre-OST0001 00000020:00000080:3.0:1788909238.469658:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8905180b6800 for lustre-OST0001 00000040:00080000:0.0:1788909238.918359:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788909238.918368:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788909238.918808:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788909238.918815:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788909238.981603:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909239.648043:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909239.648101:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909239.648289:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004890624 00000100:00100000:2.0:1788909239.648299:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004890624 00000100:00100000:0.0:1788909239.648449:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004890752 00000100:00100000:0.0:1788909239.648454:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004890752 00000100:00100000:2.0:1788909239.648749:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788909239.648763:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986c0547-f072-453e-bddd-5efe6ff9e6ca+11:2349:x1875807004890624:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909239.648780:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909239.648801:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc10400/0x733cfdd8721d5684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444b4 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909239.648818:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909239.648887:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2349:x1875807004890624:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 127us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909239.649624:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1788909239.649642:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+10:2349:x1875807004890752:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788909239.649653:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909239.649666:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9c000/0x733cfdd8721d568b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444de expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909239.649679:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909239.649715:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986c0547-f072-453e-bddd-5efe6ff9e6ca+9:2349:x1875807004890752:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 83us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909239.649722:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:2.0:1788909239.650321:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788909239.650787:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909239.650861:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004890880 00000100:00100000:2.0:1788909239.650869:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004890880 00000100:00100000:2.0:1788909239.651185:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1788909239.651196:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986c0547-f072-453e-bddd-5efe6ff9e6ca+8:2348:x1875807004890880:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909239.651208:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909239.651223:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad8200/0x733cfdd8721d5821 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44563 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909239.651238:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909239.651454:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986c0547-f072-453e-bddd-5efe6ff9e6ca+7:2348:x1875807004890880:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 260us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909239.651471:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1788909239.657251:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909239.657682:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004891136 00000100:00100000:2.0:1788909239.657693:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004891136 00000100:00100000:2.0:1788909239.657766:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 241 00000100:00100000:2.0:1788909239.657776:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+6:2346:x1875807004891136:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:2.0:1788909239.657815:0:5822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5699 00000020:00010000:2.0:1788909239.657832:0:5822:0:(genops.c:1921:obd_stale_export_put()) Put export ffff89050852c800: total 0 00000100:00080000:2.0:1788909239.657837:0:5822:0:(import.c:65:import_set_state_nolock()) ffff89050852c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788909239.657874:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1788909239.657907:0:5810:0:(genops.c:1907:obd_stale_export_get()) Get export ffff89050852c800: total 0 00010000:00010000:3.0:1788909239.657973:0:5810:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89050852c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788909239.658011:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890520ac5a00) 00010000:00010000:3.0:1788909239.658015:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788909239.658025:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89052dc11200/0x733cfdd8721d65c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44914 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909239.658056:0:5810:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89050852c800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788909239.658069:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909239.658071:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909239.658073:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909239.658131:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae3d4805-3977-4f79-88af-684dce002b2f+3:2346:x1875807004891136:12345-192.168.204.54@tcp:39:umount.0 Request processed in 356us (1028us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788909239.658139:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 241 00000100:00080000:1.0:1788909239.658442:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909239.680207:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909239.680603:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004891392 00000100:00100000:2.0:1788909239.680614:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004891392 00000100:00100000:2.0:1788909239.680683:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 293 00000100:00100000:2.0:1788909239.680692:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+7:2346:x1875807004891392:12345-192.168.204.54@tcp:251:umount.0 00000020:00000080:2.0:1788909239.680735:0:5816:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d558f 00000020:00010000:2.0:1788909239.680743:0:5816:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8905118ec800: total 0 00000100:00080000:2.0:1788909239.680747:0:5816:0:(import.c:65:import_set_state_nolock()) ffff8905118ec000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788909239.680829:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905119dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:986c0547-f072-453e-bddd-5efe6ff9e6ca+3:2346:x1875807004891392:12345-192.168.204.54@tcp:251:umount.0 Request processed in 137us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909239.680838:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 293 00000020:00010000:3.0:1788909239.680842:0:5811:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8905118ec800: total 0 00010000:00010000:3.0:1788909239.680902:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8905118ec800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788909239.680942:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501693200/0x733cfdd8721d5645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a444a6 expref: 2 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909239.680971:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8905118ec800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788909239.680982:0:5811:0:(genops.c:885:class_export_put()) final put ffff8905118ec800/986c0547-f072-453e-bddd-5efe6ff9e6ca 00010000:00010000:3.0:1788909239.680999:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909239.681001:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909239.681003:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788909239.681203:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8905118ec800/986c0547-f072-453e-bddd-5efe6ff9e6ca for MGS 00000020:00000080:2.0:1788909239.683524:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8905118ec000 for MGS 00010000:00010000:0.0:1788909240.005893:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788909240.996621:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000001:00080000:2.0:1788909240.996636:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1788909240.996650:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae3d4805-3977-4f79-88af-684dce002b2f 00000001:00080000:2.0:1788909240.996656:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788909240.996659:0:5844:0:(genops.c:885:class_export_put()) final put ffff89050852c800/ae3d4805-3977-4f79-88af-684dce002b2f 00000020:00000080:2.0:1788909240.996678:0:5844:0:(genops.c:885:class_export_put()) final put ffff890537882000/9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:2.0:1788909240.996698:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89050852c800/ae3d4805-3977-4f79-88af-684dce002b2f for lustre-MDT0000 00000020:00000080:2.0:1788909240.997086:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff890537882000/9a693284-9812-4b47-95bb-9bc33a7c4ef4 for lustre-MDT0000 00000020:00000080:2.0:1788909240.997162:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89050852c000 for lustre-MDT0000 00000020:00000080:2.0:1788909240.997180:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff890537887800 for lustre-MDT0000 00000001:00100000:0.0:1788909241.014504:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:0.0:1788909241.014522:0:6701:0:(genops.c:885:class_export_put()) final put ffff8905180b6000/9a693284-9812-4b47-95bb-9bc33a7c4ef4 00000020:00000080:3.0:1788909241.014621:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8905180b6000/9a693284-9812-4b47-95bb-9bc33a7c4ef4 for lustre-OST0000 00000020:00000080:3.0:1788909241.014676:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8905180b2000 for lustre-OST0000 00010000:00010000:2.0:1788909241.035431:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788909241.072756:0:13065:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788909241.085438:0:13065:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788909241.085489:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.085505:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.085513:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.085533:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.085563:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788909241.085592:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909241.085601:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.085611:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad8600 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909241.085616:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.085623:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909241.085629:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909241.085633:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788909241.085635:0:8452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1788909241.085663:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.085667:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909241.085692:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.085700:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89050bad8600/0x733cfdd8721d5614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d561b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.085714:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909241.085717:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788909241.085720:0:13065:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788909241.085720:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788909241.085726:0:13065:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788909241.085755:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788909241.085760:0:13065:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788909241.085768:0:13065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788909241.085774:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019544704:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788909241.085784:0:13065:0:(import.c:65:import_set_state_nolock()) ffff89052747a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788909241.085850:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019544832:0@lo:39:umount.0 00000100:00100000:1.0:1788909241.085950:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909241.086044:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019544704 00000100:00100000:1.0:1788909241.086053:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019544704 00000100:00100000:1.0:1788909241.086132:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788909241.086145:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+19:3284:x1875807019544704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788909241.086158:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909241.086174:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501693c00/0x733cfdd8721d561b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d5614 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909241.086194:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909241.086235:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de4f34ee-762f-480d-9428-329e99488659+18:3284:x1875807019544704:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909241.086243:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788909241.086286:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019544704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788909241.086364:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909241.086421:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019544832 00000100:00100000:1.0:1788909241.086425:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019544832 00000100:00100000:1.0:1788909241.086474:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788909241.086483:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875807019544832:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788909241.086507:0:5823:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d539e 00000100:00080000:1.0:1788909241.086515:0:5823:0:(import.c:65:import_set_state_nolock()) ffff8905068d8000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788909241.086747:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3282:x1875807019544832:12345-0@lo:39:umount.0 Request processed in 265us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909241.086755:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788909241.086762:0:5823:0:(genops.c:885:class_export_put()) final put ffff8905068db800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788909241.086789:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788909241.086829:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8905068db800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788909241.086905:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8905068d8000 for lustre-MDT0000 00000100:00080000:0.0:1788909241.087007:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89052747a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788909241.087051:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019544832:0@lo:39:umount.0 00000100:00080000:2.0:1788909241.087086:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788909241.087089:0:13065:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788909241.087093:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788909241.088604:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.088637:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.088644:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.088651:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089021:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909241.089029:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089037:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089043:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089049:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.089341:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788909241.089348:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.089356:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501534200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909241.089360:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.089369:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909241.089377:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909241.089383:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788909241.089385:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788909241.089416:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.089423:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788909241.089472:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019544960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909241.089536:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788909241.089596:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.089604:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501534200/0x733cfdd8721d5622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5629 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.089615:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909241.089626:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.089633:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501692200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909241.089637:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.089644:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909241.089651:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909241.089656:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788909241.089659:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788909241.089672:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.089678:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909241.089838:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1788909241.089844:0:13065:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788909241.089852:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089858:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089883:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089891:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089905:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909241.089915:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909241.089920:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089927:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad9000 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909241.089929:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089936:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909241.089943:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909241.089948:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788909241.089950:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788909241.089953:0:8450:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788909241.089969:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.089974:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909241.089990:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090002:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89050bad9000/0x733cfdd8721d584b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5852 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090013:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909241.090014:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909241.090016:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909241.090028:0:13065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090034:0:13065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090039:0:13065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090044:0:13065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090054:0:13065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788909241.090057:0:13065:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788909241.090059:0:13065:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788909241.090086:0:13065:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788909241.090090:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788909241.090095:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909241.090100:0:13065:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788909241.090106:0:13065:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff89053cc46800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788909241.090129:0:13065:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff890534063800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788909241.090135:0:13065:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff89053cc53370) has exports, disconnecting them 00000020:00080000:2.0:1788909241.090145:0:13065:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89053cc46800), last request at 1788909238 00000020:00000080:2.0:1788909241.090152:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5511 00000100:00080000:2.0:1788909241.090169:0:13065:0:(import.c:65:import_set_state_nolock()) ffff89053cc41800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788909241.090212:0:13065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89053cc46800): rc 0 00000020:00000080:2.0:1788909241.090215:0:13065:0:(genops.c:885:class_export_put()) final put ffff89053cc46800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788909241.090222:0:13065:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff890534063800), last request at 1788909238 00000020:00000080:2.0:1788909241.090225:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5446 00000100:00080000:2.0:1788909241.090230:0:13065:0:(import.c:65:import_set_state_nolock()) ffff890534067800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788909241.090239:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909241.090243:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090249:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501534400 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909241.090253:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090259:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909241.090266:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909241.090271:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788909241.090273:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788909241.090275:0:8450:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788909241.090288:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090294:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909241.090299:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090313:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501534400/0x733cfdd8721d52fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5304 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.090325:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909241.090327:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909241.090328:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788909241.090336:0:13065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff890534063800): rc 0 00000020:00000080:2.0:1788909241.090339:0:13065:0:(genops.c:885:class_export_put()) final put ffff890534063800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788909241.090345:0:13065:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa608c2c83ae0 00000100:00080000:2.0:1788909241.090363:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788909241.090366:0:13065:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788909241.090378:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788909241.090446:0:13065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788909241.090458:0:13065:0:(import.c:65:import_set_state_nolock()) ffff89052d670000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788909241.090469:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788909241.090471:0:13065:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788909241.090479:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788909241.090546:0:13065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788909241.090555:0:13065:0:(import.c:65:import_set_state_nolock()) ffff89052dc1c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788909241.090594:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff89053cc53370) has no exports 00000100:00100000:1.0:1788909241.090711:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788909241.090721:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019545088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909241.090770:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909241.090847:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019544960 00000100:00100000:1.0:1788909241.090854:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019544960 00000100:00100000:1.0:1788909241.090911:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019545088 00000100:00100000:1.0:1788909241.090915:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019545088 00000100:00100000:1.0:1788909241.090944:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788909241.090963:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+19:3285:x1875807019544960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788909241.090976:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909241.090992:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9dc00/0x733cfdd8721d5629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d5622 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909241.091007:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909241.091045:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+18:3285:x1875807019544960:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909241.091051:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788909241.091068:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788909241.091074:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+17:3285:x1875807019545088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788909241.091082:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909241.091091:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9d000/0x733cfdd8721d5550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d5549 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909241.091101:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909241.091153:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+16:3285:x1875807019545088:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909241.091160:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1788909241.091254:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff89053cc46800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1788909241.091264:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.091276:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501692200/0x733cfdd8721d5549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d5550 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.091294:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909241.091298:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909241.091301:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788909241.091311:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff890534063800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1788909241.091320:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909241.091327:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909241.091338:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019545472:0@lo:9:umount.0 00000020:00000080:1.0:1788909241.091354:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89053cc41800 for lustre-MDT0000 00000020:00000080:1.0:1788909241.091362:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff890534067800 for lustre-MDT0000 00000100:00100000:0.0:1788909241.091383:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909241.091387:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019545216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788909241.091416:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019545600:0@lo:9:umount.0 00000100:00100000:1.0:1788909241.091423:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909241.091471:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019545216 00000100:00100000:2.0:1788909241.091476:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019545216 00000100:00100000:2.0:1788909241.091513:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788909241.091524:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+16:3283:x1875807019545216:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788909241.091525:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788909241.091537:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909241.091552:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9d800/0x733cfdd8721d5852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d584b expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909241.091574:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909241.091590:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019545472 00000100:00100000:0.0:1788909241.091596:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019545472 00000100:00100000:2.0:1788909241.091603:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de4f34ee-762f-480d-9428-329e99488659+15:3283:x1875807019545216:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909241.091611:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788909241.091882:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019545600 00000100:00100000:0.0:1788909241.091887:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019545600 00000100:00100000:0.0:1788909241.091929:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788909241.091938:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875807019545472:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788909241.091963:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5493 00000100:00080000:0.0:1788909241.091971:0:6675:0:(import.c:65:import_set_state_nolock()) ffff89053460d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788909241.092006:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:3.0:1788909241.092208:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788909241.092214:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788909241.092223:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909241.092242:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019545344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788909241.092390:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3282:x1875807019545472:12345-0@lo:9:umount.0 Request processed in 453us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909241.092398:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788909241.092416:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788909241.092421:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909241.092429:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875807019545600:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788909241.092452:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d557a 00000100:00080000:0.0:1788909241.092459:0:6675:0:(import.c:65:import_set_state_nolock()) ffff89052dcff800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788909241.092481:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1788909241.092577:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909241.092608:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019545344 00000100:00100000:3.0:1788909241.092613:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019545344 00000100:00100000:3.0:1788909241.092652:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788909241.092661:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+15:3284:x1875807019545344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788909241.092672:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909241.092688:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad8c00/0x733cfdd8721d5304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d52fd expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909241.092708:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909241.092747:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de4f34ee-762f-480d-9428-329e99488659+14:3284:x1875807019545344:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909241.092754:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788909241.092760:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3282:x1875807019545600:12345-0@lo:9:umount.0 Request processed in 333us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909241.092768:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788909241.092800:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de4f34ee-762f-480d-9428-329e99488659:3284:1875807019545344:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788909241.092825:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89052d670000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788909241.092842:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:1.0:1788909241.092845:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de4f34ee-762f-480d-9428-329e99488659:3283:1875807019545216:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1788909241.092846:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788909241.092851:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019545472:0@lo:9:umount.0 00000100:00080000:0.0:1788909241.092867:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89052dc1c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788909241.092889:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788909241.092892:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788909241.092895:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019545600:0@lo:9:umount.0 00000100:00100000:3.0:1788909241.092908:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019545088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788909241.092920:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019544960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788909241.092931:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788909241.102213:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff89053cc53370) has no exports 00000020:00000080:3.0:1788909241.137466:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5358 00000020:00000080:3.0:1788909241.137479:0:13065:0:(genops.c:885:class_export_put()) final put ffff890534067000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788909241.137528:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788909241.137595:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788909241.137605:0:13065:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788909241.137610:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff89052e900000) has no exports 00000020:00000080:0.0:1788909241.137992:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5351 00000020:00000080:0.0:1788909241.137998:0:13065:0:(genops.c:885:class_export_put()) final put ffff89052d083800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788909241.138025:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff890534067000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788909241.139856:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788909241.139871:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788909241.139876:0:13065:0:(genops.c:885:class_export_put()) final put ffff89052d0b8800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788909241.139880:0:13065:0:(genops.c:844:class_export_destroy()) destroying export ffff89052d0b8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788909241.139895:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788909241.140291:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89052d083800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788909241.140503:0:13065:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff890508570de0 - data ffff890517712e58/ffff89053cb96400 00000020:01000000:0.0:1788909241.140794:0:13065:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8905095e28a0 - data ffff89051ff09510/ffff89052d0ff000 00000001:00000004:0.0:1788909241.157668:0:13065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788909241.210091:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788909241.210099:0:13065:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788909241.210157:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788909241.210160:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788909241.210498:0:7151:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788909241.210503:0:7151:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788909241.210582:0:7151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788909241.211983:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788909241.211989:0:13065:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788909241.212010:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788909241.212012:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788909241.212264:0:8090:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788909241.212269:0:8090:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788909241.212276:0:8090:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788909241.245666:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5320 00000020:00000080:2.0:1788909241.245686:0:13065:0:(genops.c:885:class_export_put()) final put ffff89053cc44800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788909241.245792:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89053cc44800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788909241.248180:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5335 00000020:00000080:2.0:1788909241.248193:0:13065:0:(genops.c:885:class_export_put()) final put ffff89053cc46000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788909241.248206:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788909241.248212:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909241.248221:0:13065:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788909241.248226:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff890508883370) has no exports 00000020:00000080:3.0:1788909241.248516:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89053cc46000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788909241.248572:0:13065:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788909241.248582:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5573 00000020:00000080:2.0:1788909241.248587:0:13065:0:(genops.c:885:class_export_put()) final put ffff89052dcfb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788909241.248601:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788909241.248605:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909241.248612:0:13065:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788909241.248615:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8905347e19b8) has no exports 00000020:00000080:2.0:1788909241.248621:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d556c 00000020:00000080:2.0:1788909241.248625:0:13065:0:(genops.c:885:class_export_put()) final put ffff89052dc19000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788909241.248806:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89052dcfb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788909241.248826:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89052dc19000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788909241.249097:0:13065:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788909241.249102:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788909241.249129:0:13065:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788909241.249137:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788909241.249152:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788909241.249207:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909241.249216:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788909241.249222:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d548c 00000020:00000080:2.0:1788909241.249227:0:13065:0:(genops.c:885:class_export_put()) final put ffff8905375bc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788909241.249235:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788909241.249240:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909241.249244:0:13065:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:3.0:1788909241.249245:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89052dc1c000 for lustre-OST0001-osc-MDT0000 00000020:00080000:2.0:1788909241.249248:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff89052d650000) has no exports 00000020:00000080:2.0:1788909241.249253:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5485 00000020:00000080:2.0:1788909241.249257:0:13065:0:(genops.c:885:class_export_put()) final put ffff89052d675000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788909241.249263:0:37:0:(genops.c:885:class_export_put()) final put ffff8905375e3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788909241.249267:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8905375e3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788909241.249273:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788909241.249738:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8905375bc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788909241.249746:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89052d675000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788909241.250150:0:13065:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788909241.250154:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788909241.250157:0:13065:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788909241.250162:0:13065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788909241.250164:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788909241.250206:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909241.250213:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788909241.250248:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909241.250251:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788909241.250255:0:13065:0:(genops.c:885:class_export_put()) final put ffff8905064ed000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788909241.250258:0:13065:0:(genops.c:844:class_export_destroy()) destroying export ffff8905064ed000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788909241.250264:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788909241.250434:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89052d670000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788909241.250441:0:37:0:(genops.c:885:class_export_put()) final put ffff8905375be000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788909241.250444:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8905375be000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788909241.250449:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788909241.250524:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d533c 00000020:00000080:2.0:1788909241.250530:0:13065:0:(genops.c:885:class_export_put()) final put ffff89053cc40000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788909241.250546:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788909241.250550:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909241.250554:0:13065:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788909241.250558:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff89053cc519b8) has no exports 00000020:00000080:2.0:1788909241.250578:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909241.250581:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788909241.250585:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5343 00000020:00000080:2.0:1788909241.250597:0:13065:0:(genops.c:885:class_export_put()) final put ffff89053cc45000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788909241.250615:0:13065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8905103af000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788909241.250618:0:13065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905103af000 3 00000020:01000004:2.0:1788909241.250625:0:13065:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8905103af000 from lustre-MDT0000 00000020:00000080:2.0:1788909241.250646:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909241.250650:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788909241.250652:0:13065:0:(genops.c:885:class_export_put()) final put ffff89053cc44000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788909241.250654:0:13065:0:(genops.c:844:class_export_destroy()) destroying export ffff89053cc44000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788909241.250661:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788909241.250685:0:13065:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788909241.250688:0:13065:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788909241.250691:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788909241.250693:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909241.250696:0:13065:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788909241.250702:0:13065:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff89050611b000 de4f34ee-762f-480d-9428-329e99488659 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788909241.250707:0:13065:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8905088819b8) has exports, disconnecting them 00000020:00080000:2.0:1788909241.250711:0:13065:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89050611b000), last request at 1788909041 00000020:00000080:2.0:1788909241.250725:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d52e1 00000020:00010000:2.0:1788909241.250729:0:13065:0:(genops.c:1921:obd_stale_export_put()) Put export ffff89050611b000: total 2 00000100:00080000:2.0:1788909241.250732:0:13065:0:(import.c:65:import_set_state_nolock()) ffff89050611f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788909241.250750:0:13065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89050611b000): rc 0 00000020:00080000:2.0:1788909241.250754:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8905088819b8) has no exports 00000100:00100000:2.0:1788909241.250832:0:5816:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff890511ae0e00:5816] 1 exiting: rc = 0 00000020:00000080:3.0:1788909241.250841:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89053cc40000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788909241.250847:0:37:0:(genops.c:885:class_export_put()) final put ffff89053cc43000/lustre-MDD0000_UUID 00000020:00010000:0.0:1788909241.250848:0:6689:0:(genops.c:1907:obd_stale_export_get()) Get export ffff89050611b000: total 2 00000020:00000080:3.0:1788909241.250850:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89053cc43000/lustre-MDD0000_UUID for lustre-MDD0000 00010000:00010000:0.0:1788909241.250854:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788909241.250862:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:0.0:1788909241.250882:0:6689:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89050611b000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788909241.250925:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9c200/0x733cfdd8721d55f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d55ea expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.250952:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890504d9de00/0x733cfdd8721d55e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d55dc expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.250962:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501535400/0x733cfdd8721d55ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d55f8 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.250972:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501693a00/0x733cfdd8721d560d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d5606 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.250983:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501692600/0x733cfdd8721d5836 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d582f expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.250992:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc10800/0x733cfdd8721d5844 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d583d expref: 4 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.251005:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890501534800/0x733cfdd8721d53f9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d53f2 expref: 3 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.251015:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89050bad8400/0x733cfdd8721d5637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x733cfdd8721d5630 expref: 2 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909241.251025:0:6689:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89050611b000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788909241.251036:0:6689:0:(genops.c:885:class_export_put()) final put ffff89050611b000/de4f34ee-762f-480d-9428-329e99488659 00010000:00010000:0.0:1788909241.251052:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909241.251054:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909241.251056:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909241.251172:0:5817:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff890531d8c000:5817] 2 exiting: rc = 0 00000100:00100000:0.0:1788909241.251183:0:5815:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff890531d8dc00:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1788909241.251221:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251229:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251235:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251242:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251248:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251254:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251260:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251267:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251274:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251287:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251293:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251298:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251382:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251389:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251395:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251402:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251409:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251415:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251421:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251427:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251433:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251438:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251508:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251516:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251522:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251527:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251531:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251536:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251542:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251550:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251557:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251566:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251572:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251578:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251585:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251592:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251599:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251607:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251614:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251621:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251629:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251636:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251645:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251654:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251671:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251678:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251685:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251692:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251700:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251707:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251714:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251721:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251729:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251737:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251744:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251751:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251759:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251770:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251781:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251790:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251799:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251804:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251833:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.251839:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788909241.252121:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89053cc45000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788909241.252129:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89050611b000/de4f34ee-762f-480d-9428-329e99488659 for MGS 00000020:00000080:2.0:1788909241.252157:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89050611f800 for MGS 20000000:01000000:2.0:1788909241.252550:0:13065:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788909241.252554:0:13065:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788909241.254084:0:13065:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8905053ef900 - data ffff89051ff35ca8/ffff890537b4ec00 00000020:01000000:2.0:1788909241.254270:0:13065:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8905068086c0 - data ffff89051ff81288/ffff8905103e3400 00000020:00000080:2.0:1788909241.254834:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d52c5 00000020:00000080:2.0:1788909241.254842:0:13065:0:(genops.c:885:class_export_put()) final put ffff890518029800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788909241.254946:0:13065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8905103af000 from MGS, refs=2 00000020:01000004:2.0:1788909241.254951:0:13065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905103af000 2 00000020:01000004:2.0:1788909241.254954:0:13065:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8905103af000 from MGS 00000020:00000080:2.0:1788909241.254982:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909241.254989:0:13065:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788909241.254993:0:13065:0:(genops.c:885:class_export_put()) final put ffff89051e8c0000/MGS 00000020:00000080:2.0:1788909241.255005:0:13065:0:(genops.c:844:class_export_destroy()) destroying export ffff89051e8c0000/MGS for MGS 00000020:01000000:2.0:1788909241.255012:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1788909241.255059:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff890518029800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788909241.255239:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788909241.255244:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909241.255250:0:13065:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788909241.255259:0:13065:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89052747e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788909241.255265:0:13065:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff89052e903370) has exports, disconnecting them 00000020:00080000:2.0:1788909241.255272:0:13065:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89052747e800), last request at 1788909042 00000020:00000080:2.0:1788909241.255277:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5390 00000020:00080000:2.0:1788909241.255288:0:13065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89052747e800): rc 0 00000020:00000080:2.0:1788909241.255293:0:13065:0:(genops.c:885:class_export_put()) final put ffff89052747e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788909241.255935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff89052747e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788909241.263632:0:13065:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788909241.263641:0:13065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788909241.263646:0:13065:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788909241.263654:0:13065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788909241.263941:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909241.263950:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788909241.263957:0:13065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905103af000 1 00000020:00000080:2.0:1788909241.263965:0:13065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d52b7 00000020:00000080:2.0:1788909241.263974:0:13065:0:(genops.c:885:class_export_put()) final put ffff89051e8c7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788909241.264069:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89052747a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788909241.264077:0:8:0:(genops.c:885:class_export_put()) final put ffff89052e90e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788909241.264080:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff89052e90e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788909241.264086:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1788909241.264276:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788909241.264282:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909241.264287:0:13065:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788909241.264291:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff890518370000) has no exports 00000020:00000080:0.0:1788909241.264603:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff89051e8c7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788909241.326437:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909241.326453:0:13065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788909241.326458:0:13065:0:(genops.c:885:class_export_put()) final put ffff8905103ab000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788909241.326462:0:13065:0:(genops.c:844:class_export_destroy()) destroying export ffff8905103ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788909241.326475:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788909241.326638:0:13065:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8905103ae800 00000020:01000000:2.0:1788909241.326669:0:13065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788909241.326673:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909241.326677:0:13065:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788909241.326682:0:13065:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff890508880000) has no exports 00000100:00100000:3.0:1788909241.326865:0:5824:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff890531d8ee00:5824] 2 exiting: rc = 0 00000100:00100000:2.0:1788909241.327003:0:7640:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff89052dcb6000:7640] 3 exiting: rc = 0 00000100:00100000:1.0:1788909241.327222:0:5822:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8905064e1400:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1788909241.327277:0:5823:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8905064e0600:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1788909241.327361:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327369:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327375:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327380:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327386:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327391:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327397:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327402:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327408:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327413:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327419:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327424:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327430:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327435:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327441:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327447:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327454:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327460:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327466:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327473:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327478:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327483:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327488:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327493:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327499:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327504:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327509:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327513:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327519:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327524:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327529:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327544:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327550:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327556:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327625:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327633:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327639:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327645:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327650:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327656:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327661:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327667:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327673:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327679:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327686:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327692:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327699:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327707:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327719:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327726:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327737:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327746:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327755:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327766:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327775:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327785:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327794:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327802:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327811:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327888:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327898:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327906:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327915:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.327925:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.335361:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff890531d8f800:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1788909241.335498:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff890531d8e000:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1788909241.335853:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335862:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335868:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335873:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335879:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335885:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335890:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335895:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335901:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335906:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335913:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335919:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335926:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335931:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335935:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335940:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335945:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335949:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335954:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335959:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335964:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335969:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335974:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335978:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335983:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335988:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.335994:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336000:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336009:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336015:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336036:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336045:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336051:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336055:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336061:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336066:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336071:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336075:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336080:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336085:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336091:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336095:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336100:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336105:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336278:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336284:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336289:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336294:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336299:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336304:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336309:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336314:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336318:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336323:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336328:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336332:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336338:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336342:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336347:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336351:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336356:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336361:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336366:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.336370:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909241.337202:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff89051198fc00:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1788909241.337334:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff89051198fe00:5828] 1 exiting: rc = 0 00000100:00100000:2.0:1788909241.337527:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337541:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337547:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337553:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337561:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337567:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337573:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337579:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337585:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337590:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337596:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337602:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337608:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337613:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337621:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337642:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337649:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337655:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337660:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337666:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337671:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337678:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337684:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337690:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337696:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337703:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337709:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337732:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337739:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337745:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337751:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337758:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337765:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337771:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337778:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337783:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337796:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337804:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337809:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337878:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337885:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337891:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337897:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337903:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337912:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337920:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337926:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337933:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337940:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337945:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337951:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337972:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337979:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337985:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337991:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.337997:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.338003:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.338009:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.338015:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.338021:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.338027:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.338034:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.338040:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.338055:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788909241.351742:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8905064e2800:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1788909241.351891:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff89051198e800:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1788909241.351994:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352003:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352007:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352013:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352018:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352024:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352041:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352061:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352067:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352072:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352077:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352082:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352088:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352093:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352099:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352104:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352143:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352151:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352157:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352162:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352167:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352172:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352176:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352181:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352185:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352190:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352195:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352199:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352204:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352209:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352214:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352220:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352225:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352230:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352235:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352240:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352246:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352251:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352257:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352262:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352267:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352271:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352284:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352288:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352293:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352298:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352303:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352309:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352313:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352317:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352322:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352326:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352330:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352335:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352340:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352345:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352350:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352355:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352359:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352364:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352368:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352373:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352379:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.352384:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788909241.353050:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff89050688ee00:5831] 0 exiting: rc = 1 00000100:00100000:1.0:1788909241.353392:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8905182cb000:5832] 1 exiting: rc = 0 00000100:00100000:2.0:1788909241.353556:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353562:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353567:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353573:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353577:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353583:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353588:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353593:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353598:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353603:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353608:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353613:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353618:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353633:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353638:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353644:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353649:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353655:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353661:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353666:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353671:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353676:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353682:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353687:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353693:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353698:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353703:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353708:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353713:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353718:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353723:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353729:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353734:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353739:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353745:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353750:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353755:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353760:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353765:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353771:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353776:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353780:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353785:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353791:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353796:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353800:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353805:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353811:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353836:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353841:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353846:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353851:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353856:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353860:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353865:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353869:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353874:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353879:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353884:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353888:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353892:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353897:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353901:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.353906:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.354641:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8905182cb800:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1788909241.354850:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8905182ca400:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1788909241.354968:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.354974:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.354980:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.354985:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.354990:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.354995:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355000:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355005:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355010:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355014:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355019:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355024:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355090:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355095:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355101:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355106:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355250:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355256:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355261:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355276:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355281:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355286:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355291:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355296:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355301:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355305:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355309:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355314:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355319:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355323:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355328:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355332:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355337:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355341:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355346:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355350:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355354:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355359:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355363:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355367:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355371:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355376:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355380:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355385:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355389:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355393:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355398:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355402:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355406:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355411:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355415:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355419:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355424:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355428:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355437:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355441:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355446:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355450:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355455:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355460:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355464:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355469:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355474:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909241.355479:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788909241.356096:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff890518891a00:5835] 0 exiting: rc = 1 00000100:00100000:3.0:1788909241.356371:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8905182cbe00:5837] 2 exiting: rc = 0 00000100:00100000:2.0:1788909241.356831:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8905182ca000:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1788909241.357627:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357634:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357639:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357644:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357649:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357653:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357659:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357664:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357671:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357676:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357681:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357687:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357692:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357698:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357703:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357709:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357715:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357720:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357726:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357731:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357737:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357742:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357757:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357763:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357781:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357788:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357793:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357798:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357803:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357808:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357823:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357830:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357835:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357840:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357845:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357850:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357855:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357860:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357866:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357871:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357876:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357881:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357888:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357892:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357898:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357904:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357909:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357916:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357937:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357945:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357950:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357955:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357960:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357965:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357970:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357975:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357981:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357992:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.357996:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.358002:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.358008:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.358013:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.358018:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788909241.358024:0:13065:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788909241.362337:0:13065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788909241.362351:0:13065:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788909241.362357:0:13065:0:(genops.c:885:class_export_put()) final put ffff8905102eb800/MDS_uuid 00000020:00000080:1.0:1788909241.362362:0:13065:0:(genops.c:844:class_export_destroy()) destroying export ffff8905102eb800/MDS_uuid for MDS 00000020:01000000:1.0:1788909241.362368:0:13065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788909241.362505:0:13065:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788909242.054497:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909243.077259:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788909243.417857:0:13215:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788909243.427794:0:13215:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788909243.427839:0:13215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909243.427853:0:13215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909243.427861:0:13215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909243.427867:0:13215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909243.427960:0:13215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788909243.427967:0:13215:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788909243.427989:0:13215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788909243.427993:0:13215:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788909243.427999:0:13215:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788909243.428019:0:13215:0:(import.c:65:import_set_state_nolock()) ffff890537882800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788909243.428087:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875807019545728:0@lo:39:umount.0 00000400:00000100:1.0:1788909243.428160:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875807019545728 offset 0 length 224: 4 00010000:00010000:0.0:1788909243.428262:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909243.428269:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909243.428277:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89050bad8000 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909243.428280:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909243.428289:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909243.428296:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909243.428302:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788909243.428305:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788909243.428307:0:8450:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788909243.428329:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909243.428335:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788909243.428366:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909243.428373:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89050bad8000/0x733cfdd8721d55f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x733cfdd8721d55ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909243.428383:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909243.428385:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909243.428386:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909243.428431:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019545856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788909243.428465:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909243.428786:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019545856 00000100:00100000:0.0:1788909243.428793:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019545856 00000100:00100000:0.0:1788909243.428831:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788909243.428838:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905053ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3285:x1875807019545856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788909243.428844:0:8451:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909243 with bad export cookie 8303790919033639649 00000100:00100000:0.0:1788909243.435766:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905053ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3285:x1875807019545856:12345-0@lo:103:ldlm_bl.0 Request processed in 6919us (7292us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788909243.435791:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788909243.437410:0:3285:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788909243.437416:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8905102e9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788909243.437420:0:3285:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788909243.441625:0:3285:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.154@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788909243.441630:0:3285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788909243.441656:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89053c8e4e00 x1875807019545856/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788909259 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788909243.441672:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788909243.441675:0:3285:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788909243.441676:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788909243.441680:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8905102e9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788909243.441685:0:3285:0:(import.c:510:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 123 00000100:00080000:3.0:1788909243.441693:0:3285:0:(import.c:624:import_select_connection()) MGC192.168.204.154@tcp: import ffff8905102e9000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788909243.441722:0:3285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8905344db480 x1875807019545984/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788909243.441809:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de4f34ee-762f-480d-9428-329e99488659:3282:1875807019545984:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788909243.441872:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875807019545984 offset 0 length 520: 4 00000100:00100000:3.0:1788909243.441942:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de4f34ee-762f-480d-9428-329e99488659:3285:1875807019545856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788909243.525593:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788909243.525617:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019546112:0@lo:400:kworker.0 00000400:00000100:0.0:1788909243.525676:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875807019546112 offset 0 length 224: 4 00000001:00100000:2.0:1788909243.555787:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788909243.555796:0:7643:0:(genops.c:885:class_export_put()) final put ffff89052dcf9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788909243.555885:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff89052dcf9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788909243.556008:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89052dcff800 for lustre-OST0001 00010000:00010000:0.0:1788909244.101391:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909245.125572:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788909246.138802:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788909246.138813:0:6701:0:(genops.c:885:class_export_put()) final put ffff89053460e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788909246.138981:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff89053460e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788909246.139047:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff89053460d800 for lustre-OST0000 00010000:00010000:1.0:1788909246.150089:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909247.173560:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909248.199204:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788909248.646218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) de4f34ee-762f-480d-9428-329e99488659->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788909248.646235:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) de4f34ee-762f-480d-9428-329e99488659->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788909248.646533:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019546240:0@lo:400:kworker.0 00000400:00000100:3.0:1788909248.646619:0:3283:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875807019546240 offset 0 length 224: 4 00010000:00010000:0.0:1788909249.222019:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909250.245516:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909251.269524:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909252.293309:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909253.317600:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788909253.765385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) de4f34ee-762f-480d-9428-329e99488659->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788909253.765401:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) de4f34ee-762f-480d-9428-329e99488659->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788909253.765483:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788909243/real 1788909243] req@ffff8905344db480 x1875807019545984/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788909253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909253.765499:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788909253.765512:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8905344db480 x1875807019545984/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788909253 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909253.765519:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019546368:0@lo:400:kworker.0 00000100:00100000:2.0:1788909253.765532:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788909243/real 1788909243] req@ffff8905344daa00 x1875807019545728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788909253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909253.765561:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8905344daa00 x1875807019545728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788909253 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000400:00000100:1.0:1788909253.765594:0:3283:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875807019546368 offset 0 length 224: 4 00000100:00080000:2.0:1788909253.765596:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8905102e9000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788909253.765625:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788909253.765633:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de4f34ee-762f-480d-9428-329e99488659:3282:1875807019545984:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788909253.765647:0:3282:0:(import.c:65:import_set_state_nolock()) ffff890537882800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788909253.765675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) de4f34ee-762f-480d-9428-329e99488659->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788909253.765689:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788909253.765692:0:37:0:(import.c:65:import_set_state_nolock()) ffff8905102e9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788909253.765696:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875807019545728:0@lo:39:umount.0 00000100:00080000:1.0:1788909253.765701:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 325 00000100:00080000:3.0:1788909253.765706:0:13215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00080000:1.0:1788909253.765708:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.154@tcp: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788909253.765717:0:13215:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8905344daa00 x1875807019545728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788909253 ref 1 fl Complete:EXNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788909253.765717:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.154@tcp: import ffff8905102e9000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788909253.765728:0:13215:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788909253.765739:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8905342a6d80 x1875807019546496/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788909253.765754:0:13215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788909253.765790:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de4f34ee-762f-480d-9428-329e99488659:3282:1875807019546496:0@lo:250:kworker.0 00000400:00000100:2.0:1788909253.765820:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875807019546496 offset 0 length 520: 4 00010000:00010000:3.0:1788909253.766654:0:13215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909253.766670:0:13215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909253.766677:0:13215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909253.766698:0:13215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909253.766724:0:13215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909253.766733:0:13215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909253.766740:0:13215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909253.766746:0:13215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909253.766752:0:13215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909253.766767:0:13215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788909253.766772:0:13215:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1788909253.766780:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788909253.766790:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788909253.766799:0:13215:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1788909253.766801:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501534000 already unused, calling callback (ffffffffc1b52c20) 00000020:01000000:3.0:1788909253.766804:0:13215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 10000000:00010000:0.0:1788909253.766807:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788909253.766811:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788909253.766818:0:13215:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1788909253.766820:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788909253.766825:0:13215:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff89053cc54d28) has no exports 10000000:00010000:0.0:1788909253.766832:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909253.766840:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788909253.766843:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788909253.766847:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00080000:3.0:1788909253.766854:0:13215:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff89053cc54d28) has no exports 00010000:00010000:0.0:1788909253.766862:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8905102e9000 00010000:00010000:0.0:1788909253.766868:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909253.766876:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501534000/0x733cfdd8721d5606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d560d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909253.766892:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909253.766896:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909253.766903:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501693000 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909253.766906:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909253.766921:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909253.766927:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909253.766933:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788909253.766936:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788909253.766937:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788909253.766943:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8905102e9000 00010000:00010000:0.0:1788909253.766947:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909253.766953:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501693000/0x733cfdd8721d583d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d5844 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909253.766962:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909253.766963:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909253.766965:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909253.766983:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788909253.770082:0:13215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff890537b30f60 - data ffff890537da00d8/ffff89052d411c00 00000020:01000000:3.0:1788909253.770254:0:13215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff890533d29ba0 - data ffff89051ff42948/ffff890537335400 00100000:10000000:3.0:1788909253.780304:0:13215:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788909253.805038:0:13215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d5415 00000020:00000080:2.0:1788909253.805049:0:13215:0:(genops.c:885:class_export_put()) final put ffff8905375e3000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788909253.805072:0:13215:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8905068d9800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788909253.805075:0:13215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905068d9800 2 00000020:01000004:2.0:1788909253.805079:0:13215:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8905068d9800 from lustre-OST0000 00000020:00000080:2.0:1788909253.805105:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909253.805141:0:13215:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788909253.805144:0:13215:0:(genops.c:885:class_export_put()) final put ffff8905375e4000/lustre-OST0000_UUID 00000020:00000080:2.0:1788909253.805147:0:13215:0:(genops.c:844:class_export_destroy()) destroying export ffff8905375e4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788909253.805153:0:13215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788909253.805194:0:13215:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788909253.805198:0:13215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788909253.805202:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909253.805207:0:13215:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788909253.805213:0:13215:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff890537881800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788909253.805219:0:13215:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff89052e9019b8) has exports, disconnecting them 00000020:00080000:2.0:1788909253.805224:0:13215:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff890537881800), last request at 1788909058 00000020:00000080:2.0:1788909253.805228:0:13215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d543f 00000020:00080000:2.0:1788909253.805237:0:13215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff890537881800): rc 0 00000020:00000080:2.0:1788909253.805241:0:13215:0:(genops.c:885:class_export_put()) final put ffff890537881800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788909253.805690:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8905375e3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788909253.805713:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff890537881800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788909253.806654:0:13215:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788909253.806660:0:13215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788909253.806664:0:13215:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788909253.806671:0:13215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788909253.806839:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788909253.806846:0:13215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788909253.806851:0:13215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905068d9800 1 00000020:00000080:3.0:1788909253.806856:0:13215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d53cf 00000020:00000080:3.0:1788909253.806862:0:13215:0:(genops.c:885:class_export_put()) final put ffff890508508800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788909253.806867:0:13215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788909253.806871:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788909253.806874:0:13215:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788909253.806877:0:13215:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff890518373370) has no exports 00000020:00000080:0.0:1788909253.806983:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff890537882800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788909253.806990:0:37:0:(genops.c:885:class_export_put()) final put ffff890537886000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788909253.806993:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff890537886000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788909253.806998:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788909253.807050:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff890508508800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788909253.828405:0:13215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788909253.828423:0:13215:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788909253.828430:0:13215:0:(genops.c:885:class_export_put()) final put ffff890534608000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788909253.828435:0:13215:0:(genops.c:844:class_export_destroy()) destroying export ffff890534608000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788909253.828445:0:13215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788909253.828606:0:13215:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8905068db000 00000020:02000400:3.0:1788909253.828659:0:13215:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788909254.342318:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909255.370915:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788909255.851962:0:13371:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788909255.859689:0:13371:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788909255.859786:0:13371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909255.859803:0:13371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909255.859810:0:13371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909255.859834:0:13371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909255.859977:0:13371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788909255.859986:0:13371:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788909255.860009:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1788909255.860013:0:13371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788909255.860020:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909255.860029:0:13371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89053c8e7b80 x1875807019546112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909259 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788909255.860051:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501535c00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:0.0:1788909255.860055:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909255.860060:0:13371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89052df6e300 x1875807019546240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909264 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788909255.860080:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909255.860089:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909255.860095:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788909255.860097:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788909255.860100:0:8450:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788909255.860141:0:8450:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8905102e9000 00010000:00010000:0.0:1788909255.860147:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909255.860154:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501535c00/0x733cfdd8721d55dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d55e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909255.860170:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909255.860172:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909255.860175:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909255.860200:0:13371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8905342a5880 x1875807019546368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909269 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909255.860209:0:13371:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788909255.860217:0:13371:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788909255.860254:0:13371:0:(import.c:65:import_set_state_nolock()) ffff890537b21000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788909255.860311:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019546240:0@lo:400:kworker.0 00000100:00100000:2.0:1788909255.860333:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019546368:0@lo:400:kworker.0 00000100:00100000:0.0:1788909255.860364:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875807019546624:0@lo:39:umount.0 00000400:00000100:0.0:1788909255.860430:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875807019546624 offset 0 length 224: 4 00000100:00100000:3.0:1788909255.860666:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875807019546112:0@lo:400:kworker.0 00010000:00010000:0.0:1788909256.389356:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909257.416718:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909258.439576:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788909258.885555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) de4f34ee-762f-480d-9428-329e99488659->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788909258.885591:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) de4f34ee-762f-480d-9428-329e99488659->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788909259.465701:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909260.485990:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909261.509636:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909262.534949:0:6689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909263.557511:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788909264.005470:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) de4f34ee-762f-480d-9428-329e99488659->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788909264.005482:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) de4f34ee-762f-480d-9428-329e99488659->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788909264.581560:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909265.029582:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788909255/real 1788909255] req@ffff8905342a4e00 x1875807019546624/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788909265 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909265.029616:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8905342a4e00 x1875807019546624/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788909265 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788909265.029675:0:3282:0:(import.c:65:import_set_state_nolock()) ffff890537b21000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788909265.029746:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875807019546624:0@lo:39:umount.0 00000100:00080000:1.0:1788909265.029965:0:13371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788909265.029970:0:13371:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788909265.029975:0:13371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788909265.032654:0:13371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909265.032697:0:13371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909265.032705:0:13371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909265.032712:0:13371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909265.032740:0:13371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788909265.032747:0:13371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909265.032753:0:13371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909265.032759:0:13371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909265.032765:0:13371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909265.033083:0:13371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788909265.033088:0:13371:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788909265.033147:0:13371:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788909265.033152:0:13371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788909265.033157:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788909265.033174:0:13371:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788909265.033179:0:13371:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff89052d653370) has no exports 00000020:00080000:1.0:1788909265.033212:0:13371:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff89052d653370) has no exports 00000020:01000000:1.0:1788909265.037628:0:13371:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff89052d42c8a0 - data ffff890537d82438/ffff89052dce7400 00000020:01000000:1.0:1788909265.037831:0:13371:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff890537bcfd20 - data ffff890517406948/ffff89053753b400 00010000:00010000:2.0:1788909265.038231:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788909265.038244:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909265.038257:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890501534c00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909265.038262:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909265.038276:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909265.038285:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909265.038291:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788909265.038294:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788909265.038298:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788909265.038323:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8905102e9000 00010000:00010000:2.0:1788909265.038327:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909265.038333:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501534c00/0x733cfdd8721d55ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d55f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909265.038345:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909265.038349:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909265.038390:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c800 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909265.038393:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909265.038402:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909265.038408:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909265.038413:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788909265.038416:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788909265.038418:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788909265.038424:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8905102e9000 00010000:00010000:2.0:1788909265.038427:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909265.038434:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890504d9c800/0x733cfdd8721d582f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d5836 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909265.038450:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909265.038452:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909265.038454:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909265.039907:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788909265.051405:0:13371:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788909265.080495:0:13371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d54e0 00000020:00000080:0.0:1788909265.080509:0:13371:0:(genops.c:885:class_export_put()) final put ffff890537884800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788909265.080528:0:13371:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8905375be800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788909265.080532:0:13371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905375be800 2 00000020:01000004:0.0:1788909265.080536:0:13371:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8905375be800 from lustre-OST0001 00000020:00000080:2.0:1788909265.080541:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff890537884800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788909265.080569:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788909265.080582:0:13371:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788909265.080586:0:13371:0:(genops.c:885:class_export_put()) final put ffff89052d673000/lustre-OST0001_UUID 00000020:00000080:0.0:1788909265.080588:0:13371:0:(genops.c:844:class_export_destroy()) destroying export ffff89052d673000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788909265.080596:0:13371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788909265.080720:0:13371:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import de4f34ee-762f-480d-9428-329e99488659->MGS 00010000:00010000:0.0:1788909265.080739:0:13371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d53f9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909265.080753:0:13371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d53f9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909265.080759:0:13371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788909265.080762:0:13371:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788909265.080766:0:13371:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788909265.080800:0:13371:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8905102e9000 00010000:00010000:0.0:1788909265.080804:0:13371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890504d9c600/0x733cfdd8721d53f2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d53f9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909265.080823:0:13371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x733cfdd8721d5637 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788909265.080830:0:13371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x733cfdd8721d5637 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909265.080835:0:13371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788909265.080837:0:13371:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788909265.080839:0:13371:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788909265.080847:0:13371:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8905102e9000 00010000:00010000:0.0:1788909265.080849:0:13371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff890501534600/0x733cfdd8721d5630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x733cfdd8721d5637 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788909265.080866:0:13371:0:(import.c:65:import_set_state_nolock()) ffff8905102e9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788909265.080870:0:13371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788909265.080872:0:13371:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788909265.080873:0:13371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788909265.080877:0:13371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788909265.080888:0:13371:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8905342a6d80 x1875807019546496/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788909268 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788909265.080906:0:13371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788909265.080909:0:13371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1788909265.081009:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de4f34ee-762f-480d-9428-329e99488659:3282:1875807019546496:0@lo:250:kworker.0 10000000:01000000:0.0:1788909265.081084:0:13371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788909265.081093:0:13371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d52d3 00000020:00000080:0.0:1788909265.081098:0:13371:0:(genops.c:885:class_export_put()) final put ffff8905102ea000/de4f34ee-762f-480d-9428-329e99488659 00000020:00000080:2.0:1788909265.082899:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8905102ea000/de4f34ee-762f-480d-9428-329e99488659 for MGC192.168.204.154@tcp 00000020:01000000:0.0:1788909265.084201:0:13371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.154@tcp (flags='') 00000020:00000080:0.0:1788909265.084255:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788909265.084269:0:13371:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.154@tcp: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788909265.084295:0:13371:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff890508884d28) has no exports 10000000:01000000:2.0:1788909265.084498:0:5820:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788909265.086232:0:13371:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.154@tcp: client import never connected 00000100:00080000:0.0:1788909265.086243:0:13371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788909265.086248:0:13371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788909265.086254:0:13371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788909265.086258:0:13371:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788909265.086428:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788909265.086440:0:13371:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.154@tcp (uuid de4f34ee-762f-480d-9428-329e99488659) 00000020:01000000:0.0:1788909265.086451:0:13371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788909265.086461:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788909265.086468:0:13371:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788909265.086477:0:13371:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff890537b22000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788909265.086485:0:13371:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff89052d6519b8) has exports, disconnecting them 00000020:00080000:0.0:1788909265.086492:0:13371:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff890537b22000), last request at 1788909077 00000020:00000080:0.0:1788909265.086499:0:13371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d550a 00000020:00080000:0.0:1788909265.086525:0:13371:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff890537b22000): rc 0 00000020:00000080:0.0:1788909265.086531:0:13371:0:(genops.c:885:class_export_put()) final put ffff890537b22000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788909265.086824:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8905102e9000 for MGC192.168.204.154@tcp 00000020:00000080:2.0:1788909265.086846:0:36:0:(genops.c:885:class_export_put()) final put ffff8905102ed800/de4f34ee-762f-480d-9428-329e99488659 00000020:00000080:2.0:1788909265.086848:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8905102ed800/de4f34ee-762f-480d-9428-329e99488659 for MGC192.168.204.154@tcp 00000020:01000000:2.0:1788909265.086855:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.154@tcp (de4f34ee-762f-480d-9428-329e99488659) 00000020:00000080:3.0:1788909265.087468:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff890537b22000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788909265.092973:0:13371:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788909265.092982:0:13371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788909265.092986:0:13371:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788909265.092995:0:13371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788909265.093062:0:6689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1788909265.093247:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff890537b21000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788909265.097212:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788909265.097564:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788909265.098207:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:3.0:1788909265.099511:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:2.0:1788909265.099763:0:7631:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff89052dc4aa00:7631] 2 exiting: rc = 0 00000100:00100000:3.0:1788909265.099867:0:5805:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff89051e979e00:5805] 0 exiting: rc = 1 00000100:00100000:3.0:1788909265.099957:0:5806:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff890504c2ba00:5806] 1 exiting: rc = 0 00000100:00100000:2.0:1788909265.100067:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.100403:0:8451:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff89053cba6600:8451] 3 exiting: rc = 0 00000100:00100000:3.0:1788909265.100544:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff890508429200:5807] 0 exiting: rc = 1 00000100:00100000:3.0:1788909265.100603:0:5808:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff890504c2b000:5808] 1 exiting: rc = 0 00000100:00100000:3.0:1788909265.100658:0:5809:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff890508429800:5809] 2 exiting: rc = 0 00000100:00100000:2.0:1788909265.101586:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101596:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101603:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101609:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101620:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101628:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101636:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101642:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101656:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101662:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101668:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101675:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101682:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101690:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101699:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101705:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101712:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101721:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101727:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101734:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101739:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101769:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101775:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101781:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101789:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101793:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101799:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101804:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101811:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101816:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101822:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101827:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101832:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101837:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101842:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101848:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101853:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101859:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101864:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101868:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101874:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101879:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101885:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101890:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101895:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101900:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101906:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101912:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101926:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101931:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101935:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101940:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101945:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101950:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101955:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101960:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101974:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101979:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101984:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101989:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101994:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.101999:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.102005:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.102019:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788909265.108170:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788909265.108187:0:13371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788909265.108194:0:13371:0:(genops.c:885:class_export_put()) final put ffff890537b26000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788909265.108200:0:13371:0:(genops.c:844:class_export_destroy()) destroying export ffff890537b26000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788909265.108213:0:13371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788909265.108274:0:13371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905375be800 1 00000020:00000080:3.0:1788909265.108280:0:13371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x733cfdd8721d54af 00000020:00000080:3.0:1788909265.108286:0:13371:0:(genops.c:885:class_export_put()) final put ffff8905375e5800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788909265.108305:0:13371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788909265.108310:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788909265.108325:0:13371:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788909265.108330:0:13371:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff89053cc50000) has no exports 00000020:00000080:2.0:1788909265.108389:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8905375e5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788909265.130754:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909265.130769:0:13371:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788909265.130774:0:13371:0:(genops.c:885:class_export_put()) final put ffff8905375e2000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788909265.130779:0:13371:0:(genops.c:844:class_export_destroy()) destroying export ffff8905375e2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788909265.130788:0:13371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788909265.131092:0:13371:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8905375ba800 00000020:01000000:2.0:1788909265.131138:0:13371:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788909265.131143:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788909265.131148:0:13371:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788909265.131153:0:13371:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff89052d654d28) has no exports 00000020:00000080:2.0:1788909265.131183:0:13371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788909265.131190:0:13371:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788909265.131193:0:13371:0:(genops.c:885:class_export_put()) final put ffff89050850e800/OSS_uuid 00000020:00000080:2.0:1788909265.131195:0:13371:0:(genops.c:844:class_export_destroy()) destroying export ffff89050850e800/OSS_uuid for OSS 00000020:01000000:2.0:1788909265.131200:0:13371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788909265.131226:0:5818:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788909265.131433:0:8092:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff89053c427400:8092] 3 exiting: rc = 0 00000100:00100000:2.0:1788909265.133425:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff890533d64000:6676] 2 exiting: rc = 0 00000100:00100000:0.0:1788909265.133648:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8905118c6800:6675] 1 exiting: rc = 0 00000100:00100000:2.0:1788909265.135201:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff890533d3f000:6673] 0 exiting: rc = 1 00000100:00100000:2.0:1788909265.135302:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135311:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135327:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135335:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135341:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135379:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135384:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135391:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135396:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135402:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135408:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135414:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135428:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135434:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135440:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135446:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135452:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135457:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135463:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135468:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135477:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135484:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135489:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135494:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135500:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135506:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135516:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135521:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135527:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135533:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135538:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135544:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135550:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135557:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135562:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135568:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135574:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135580:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135585:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135590:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135603:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135609:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135614:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135620:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135625:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135631:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135636:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135641:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135646:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135654:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135659:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135665:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135670:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135675:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135680:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135685:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135691:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135696:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135701:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135706:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135711:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135717:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135721:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.135727:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.137293:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff89050689b000:6677] 0 exiting: rc = 1 00000100:00100000:2.0:1788909265.138215:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff89050689a800:6678] 1 exiting: rc = 0 00000100:00100000:2.0:1788909265.138286:0:11699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff890537b3aa00:11699] 2 exiting: rc = 0 00000100:00100000:3.0:1788909265.138589:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138597:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138603:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138608:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138613:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138619:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138625:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138631:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138636:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138642:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138648:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138653:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138659:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138665:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138671:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138677:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138683:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138689:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138694:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138699:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138705:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138710:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138715:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138720:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138725:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138730:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138735:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138741:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138747:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138752:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138757:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138762:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138782:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138788:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138793:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138798:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138803:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138808:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138813:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138819:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138824:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138830:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138837:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138843:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138852:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138859:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138865:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138872:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138972:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138982:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138987:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138992:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.138997:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139002:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139007:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139013:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139018:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139024:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139029:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139035:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139041:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139046:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139306:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.139313:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.143804:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff89050689ac00:6681] 2 exiting: rc = 0 00000100:00100000:0.0:1788909265.144348:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff89050689b800:6680] 1 exiting: rc = 0 00000100:00100000:0.0:1788909265.144569:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff89050689bc00:6679] 0 exiting: rc = 1 00000100:00100000:2.0:1788909265.144628:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144638:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144653:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144675:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144681:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144687:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144694:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144714:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144719:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144725:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144731:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144737:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144743:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144749:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144755:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144764:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144770:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144775:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144780:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144793:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144799:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144804:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144809:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144815:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144820:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144825:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144830:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144836:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144849:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144853:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144858:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144862:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144867:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144871:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144875:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144880:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144884:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144889:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144893:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144898:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144907:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144912:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144929:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144948:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144954:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144960:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144966:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144975:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144981:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144986:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144990:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.144995:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145000:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145004:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145009:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145013:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145018:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145023:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145029:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145034:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145038:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145044:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145050:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.145062:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.149857:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff890533d6ce00:6683] 1 exiting: rc = 0 00000100:00100000:0.0:1788909265.150864:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff890533d6d000:6682] 0 exiting: rc = 1 00000100:00100000:2.0:1788909265.151062:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151073:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151081:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151089:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151096:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151101:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151135:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151142:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151147:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151152:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151158:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151163:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151183:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151187:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151193:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151198:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151203:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151208:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151213:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151218:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151223:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151229:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151234:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151238:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151243:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151248:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151252:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151257:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151262:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151266:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151271:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151275:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151279:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151285:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151292:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151297:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151302:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151309:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151341:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151415:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151420:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151430:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151436:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151442:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151448:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151453:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151458:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151471:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151476:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151482:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151487:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151501:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151506:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151511:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151515:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151520:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151525:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151529:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151534:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151538:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151543:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151548:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151552:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.151563:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788909265.154415:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff890533d65000:6684] 0 exiting: rc = 1 00000100:00100000:2.0:1788909265.154554:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff890533d64e00:6685] 1 exiting: rc = 0 00000100:00100000:2.0:1788909265.154717:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154727:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154733:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154740:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154747:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154754:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154760:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154766:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154785:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154793:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154800:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154811:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154847:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154853:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154861:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154868:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154875:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154896:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154903:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154910:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154932:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154940:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154946:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154954:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154961:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154967:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154974:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154983:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154990:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.154997:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155004:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155011:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155034:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155043:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155049:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155055:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155061:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155067:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155073:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155079:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155085:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155091:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155100:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155173:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155200:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155209:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155216:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155223:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155229:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155236:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155243:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155250:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155265:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155273:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155279:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155285:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155307:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155315:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155322:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155328:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155334:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155341:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155349:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788909265.155366:0:13371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788909265.175369:0:13371:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788909279.244062:0:13989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788909286.936735:0:14450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788909286.936739:0:14450:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788909286.936845:0:14450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89053c610000 00000020:01000004:2.0:1788909286.936861:0:14450:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788909286.936869:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788909286.936885:0:14450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8905347e4d28) 00000020:00000080:2.0:1788909286.936899:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788909286.957335:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788909286.959920:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788909286.960599:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788909286.960701:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788909286.960855:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788909286.961212:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788909286.961291:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:2.0:1788909286.961388:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:2.0:1788909286.961563:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:2.0:1788909286.961807:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:2.0:1788909286.963777:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 453: rc = 0 00100000:10000000:2.0:1788909286.963890:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 453: rc = 0 00100000:10000000:2.0:1788909286.964723:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 254: rc = 0 00100000:10000000:2.0:1788909286.965079:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 254: rc = 0 00100000:10000000:2.0:1788909286.965429:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 254: rc = 0 00100000:10000000:2.0:1788909286.965798:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 254: rc = 0 00100000:10000000:2.0:1788909286.966261:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 254: rc = 0 00100000:10000000:2.0:1788909286.966606:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 254: rc = 0 00100000:10000000:2.0:1788909286.966891:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 254: rc = 0 00100000:10000000:2.0:1788909286.967316:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 254: rc = 0 00100000:10000000:2.0:1788909286.967655:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 254: rc = 0 00100000:10000000:2.0:1788909286.967917:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 254: rc = 0 00100000:10000000:2.0:1788909286.968398:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 254: rc = 0 00100000:10000000:2.0:1788909286.968779:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 254: rc = 0 00100000:10000000:2.0:1788909286.969351:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 467: rc = 0 00100000:10000000:2.0:1788909286.969703:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 467: rc = 0 00100000:10000000:2.0:1788909286.969982:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 467: rc = 0 00100000:10000000:2.0:1788909286.970416:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 467: rc = 0 00100000:10000000:2.0:1788909286.970755:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 467: rc = 0 00100000:10000000:2.0:1788909286.971246:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 467: rc = 0 00100000:10000000:2.0:1788909286.971593:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 467: rc = 0 00100000:10000000:2.0:1788909286.971851:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 467: rc = 0 00100000:10000000:0.0:1788909286.972557:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 467: rc = 0 00100000:10000000:0.0:1788909286.972830:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 467: rc = 0 00100000:10000000:0.0:1788909286.973288:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 467: rc = 0 00100000:10000000:0.0:1788909286.973636:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 467: rc = 0 00100000:10000000:0.0:1788909286.973914:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 467: rc = 0 00100000:10000000:0.0:1788909286.974367:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 467: rc = 0 00100000:10000000:0.0:1788909286.974710:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 467: rc = 0 00100000:10000000:0.0:1788909286.974978:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 467: rc = 0 00100000:10000000:0.0:1788909286.975519:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 467: rc = 0 00100000:10000000:0.0:1788909286.975788:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 467: rc = 0 00100000:10000000:0.0:1788909286.976299:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 467: rc = 0 00100000:10000000:0.0:1788909286.976620:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 467: rc = 0 00100000:10000000:0.0:1788909286.976964:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 467: rc = 0 00100000:10000000:0.0:1788909286.977276:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 467: rc = 0 00100000:10000000:0.0:1788909286.977546:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 467: rc = 0 00100000:10000000:0.0:1788909286.977803:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 467: rc = 0 00100000:10000000:0.0:1788909286.978071:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 467: rc = 0 00100000:10000000:0.0:1788909286.978383:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 467: rc = 0 00100000:10000000:0.0:1788909286.978643:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 467: rc = 0 00100000:10000000:0.0:1788909286.978901:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 467: rc = 0 00100000:10000000:0.0:1788909286.986342:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 467: rc = 0 00100000:10000000:0.0:1788909286.986959:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 467: rc = 0 00100000:10000000:0.0:1788909286.987326:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 467: rc = 0 00100000:10000000:0.0:1788909286.987810:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 467: rc = 0 00100000:10000000:0.0:1788909286.988411:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 6: rc = 0 00100000:10000000:0.0:1788909286.989752:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788909286.990105:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 454: rc = 0 00100000:10000000:0.0:1788909286.990351:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788909286.990421:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 454: rc = 0 00100000:10000000:0.0:1788909286.990773:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788909286.990919:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 454: rc = 0 00100000:10000000:0.0:1788909286.991546:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788909286.991624:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 666: rc = 0 00100000:10000000:0.0:1788909286.991987:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788909286.992386:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 666: rc = 0 00100000:10000000:0.0:1788909286.992735:0:14450:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788909286.992809:0:14450:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 666: rc = 0 00000020:00000080:0.0:1788909286.993328:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788909286.993336:0:14450:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788909286.993349:0:14450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d65d4 00000020:01000004:0.0:1788909286.993357:0:14450:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788909286.993362:0:14450:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788909286.993368:0:14450:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89053c610000 from MGS 00000020:01000004:0.0:1788909286.993372:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788909286.993382:0:14450:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8905183719b8) 00000020:00000080:0.0:1788909286.993392:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788909286.993512:0:14450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89053c610000 from MGS, refs=2 00080000:01000000:0.0:1788909286.993518:0:14450:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788909286.993524:0:14450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d65e2 00000100:00100000:0.0:1788909286.993628:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788909286.993927:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788909286.993935:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788909286.994755:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788909286.994763:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788909286.995719:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788909286.995969:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788909286.995976:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788909286.997094:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788909286.997230:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788909286.997816:0:14450:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788909286.997892:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788909286.999087:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909286.999092:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909286.999094:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909286.999709:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909286.999712:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909286.999714:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909287.000509:0:14450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788909287.006549:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788909287.016628:0:14450:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788909287.016710:0:14450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788909287.016713:0:14450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788909287.019283:0:14459:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788909287.019748:0:14450:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788909287.019923:0:14450:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788909287.023305:0:14450:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788909287.023633:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909287.023851:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788909287.023858:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788909287.025786:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788909287.025799:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788909287.026710:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788909287.026718:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788909287.027965:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788909287.027991:0:14450:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:1.0:1788909287.027993:0:14450:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788909287.028039:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:1.0:1788909287.028053:0:14450:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (ffff89052e904d28) 00000020:00000080:1.0:1788909287.028068:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788909287.028216:0:14450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890537e8f000@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788909287.028369:0:14450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:1.0:1788909287.028376:0:14450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788909287.028988:0:14464:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788909287.029347:0:14465:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788909287.029428:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid af89eede-3fcd-45ad-88b4-973cc21df0c9) 00000020:00000080:1.0:1788909287.029527:0:14450:0:(genops.c:1385:class_connect()) connect: client af89eede-3fcd-45ad-88b4-973cc21df0c9, cookie 0x733cfdd8721d65f0 00000100:00080000:1.0:1788909287.029541:0:14450:0:(import.c:510:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788909287.029547:0:14450:0:(import.c:624:import_select_connection()) MGC192.168.204.154@tcp: import ffff890537e8f000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788909287.029578:0:14450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8905342a7800 x1875807019546752/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788909287.029656:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:af89eede-3fcd-45ad-88b4-973cc21df0c9:3282:1875807019546752:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788909287.029730:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788909287.029989:0:14450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import af89eede-3fcd-45ad-88b4-973cc21df0c9->MGS 00000020:01000004:1.0:1788909287.030023:0:14450:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788909287.030052:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788909287.030067:0:14450:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff89052e9019b8) 00000020:00000080:1.0:1788909287.030087:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788909287.030634:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019546752 00000100:00100000:3.0:1788909287.030650:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019546752 00000100:00100000:3.0:1788909287.030686:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788909287.030693:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875807019546752:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788909287.030715:0:14460:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from af89eede-3fcd-45ad-88b4-973cc21df0c9@0@lo t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:3.0:1788909287.030742:0:14460:0:(genops.c:1385:class_connect()) connect: client af89eede-3fcd-45ad-88b4-973cc21df0c9, cookie 0x733cfdd8721d65fe 00000100:00080000:3.0:1788909287.030873:0:14460:0:(import.c:65:import_set_state_nolock()) ffff89051a12c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788909287.037687:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+5:3282:x1875807019546752:12345-0@lo:250:mount.lustre.0 Request processed in 6981us (7945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.037703:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909287.041793:0:3282:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788909287.041815:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:2.0:1788909287.041891:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788909287.041898:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788909287.041905:0:3282:0:(import.c:65:import_set_state_nolock()) ffff890537e8f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788909287.041910:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788909287.041981:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788909287.041992:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:af89eede-3fcd-45ad-88b4-973cc21df0c9:3282:1875807019546752:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788909287.049777:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909287.049973:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788909287.049980:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788909287.056264:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788909287.056279:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788909287.056704:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788909287.056711:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788909287.057506:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909287.057685:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788909287.057690:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788909287.058731:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788909287.058740:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788909287.105591:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788909287.105810:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788909287.105818:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788909287.107285:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788909287.107299:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788909287.109946:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788909287.110352:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788909287.110360:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788909287.113832:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788909287.113859:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788909287.115699:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788909287.115889:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788909287.115895:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788909287.120912:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788909287.120929:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788909287.121985:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788909287.122325:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788909287.122331:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788909287.134267:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788909287.134292:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788909287.169528:0:14450:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788909287.169806:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788909287.169815:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788909287.178471:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788909287.178487:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788909287.179404:0:14450:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788909287.179413:0:14450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788909287.182759:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788909287.182792:0:14450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788909287.182798:0:14450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788909287.182975:0:14450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788909287.183017:0:14450:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788909287.183021:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788909287.183023:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788909287.183024:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909287.183026:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909287.183027:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909287.183028:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909287.183029:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788909287.183030:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788909287.183032:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909287.183034:0:14450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788909287.183036:0:14450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788909287.183038:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788909287.183039:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788909287.183040:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909287.183045:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909287.183046:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909287.183047:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909287.183048:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788909287.183048:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788909287.183049:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909287.183050:0:14450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788909287.183089:0:14450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788909287.183146:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019546880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788909287.183217:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.183266:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788909287.183347:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019546880 00000100:00100000:0.0:1788909287.183356:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019546880 00000100:00100000:0.0:1788909287.183401:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788909287.183410:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+5:14450:x1875807019546880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788909287.183454:0:14463:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788909287.183457:0:14463:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788909287.183460:0:14463:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788909287.193837:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788909287.194279:0:14463:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788909287.199842:0:14484:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788909287.199852:0:14484:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788909287.199855:0:14484:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788909287.199888:0:14484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788909287.200505:0:14463:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788909287.200518:0:14463:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788909287.229571:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+5:14450:x1875807019546880:12345-0@lo:253:mount.lustre.0 Request processed in 46151us (46343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.229588:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788909287.230151:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019546880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788909287.230168:0:14450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788909287.230172:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788909287.230175:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788909287.230176:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909287.230177:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909287.230178:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909287.230179:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909287.230181:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788909287.230183:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788909287.230184:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909287.230186:0:14450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788909287.230212:0:14450:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89053c610000 from lustre-MDT0000 10000000:01000000:2.0:1788909287.230247:0:14450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788909287.230250:0:14450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788909287.230255:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89052e904d28 10000000:01000000:2.0:1788909287.230260:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788909287.230268:0:14450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89052e904d28 from 1 10000000:01000000:2.0:1788909287.230272:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788909287.230311:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.230321:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.230475:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909287.230499:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788909287.230553:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.230595:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.230942:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019547008 00000100:00100000:3.0:1788909287.230950:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019547008 00000100:00100000:3.0:1788909287.230998:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788909287.231008:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+5:14450:x1875807019547008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909287.231023:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909287.231043:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a6e00/0x733cfdd8721d660c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d6605 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.231067:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a6e00/0x733cfdd8721d660c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d6605 expref: 6 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.231078:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a6e00/0x733cfdd8721d660c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d6605 expref: 6 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.231087:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6e00, rc 0) 00000100:00100000:3.0:1788909287.231314:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+6:14450:x1875807019547008:12345-0@lo:101:mount.lustre.0 Request processed in 307us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.231322:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788909287.231473:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788909287.231500:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.231510:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909287.231571:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788909287.231599:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.231808:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.231864:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019547136 00000100:00100000:3.0:1788909287.231868:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019547136 00000100:00100000:3.0:1788909287.231902:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909287.231909:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+6:14450:x1875807019547136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909287.232310:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+6:14450:x1875807019547136:12345-0@lo:501:mount.lustre.0 Request processed in 399us (708us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788909287.232318:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788909287.232465:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547136:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788909287.232490:0:14450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788909287.232510:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.232519:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909287.232528:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89053c610000 10000000:01000000:2.0:1788909287.232533:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788909287.232544:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89053c610000 10000000:01000000:2.0:1788909287.232547:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788909287.232550:0:14450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89053c610000 from 1 10000000:01000000:2.0:1788909287.232552:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788909287.232574:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc11800/0x733cfdd8721d6613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.232582:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89052dc11800/0x733cfdd8721d6613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.232590:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89052dc11800/0x733cfdd8721d6613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909287.232605:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788909287.232813:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.232894:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788909287.233101:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019547264 00000100:00100000:1.0:1788909287.233414:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019547264 00000100:00100000:0.0:1788909287.233646:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788909287.233657:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+6:14450:x1875807019547264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788909287.233669:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909287.233698:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89053c516800/0x733cfdd8721d661a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d6613 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909287.233722:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89053c516800/0x733cfdd8721d661a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d6613 expref: 7 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909287.233733:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89053c516800/0x733cfdd8721d661a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d6613 expref: 7 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909287.233741:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516800, rc 0) 00000100:00100000:0.0:1788909287.233795:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+7:14450:x1875807019547264:12345-0@lo:101:mount.lustre.0 Request processed in 140us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909287.233817:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788909287.233900:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788909287.233914:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89052dc11800/0x733cfdd8721d6613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d661a expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.233924:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89052dc11800/0x733cfdd8721d6613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d661a expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909287.233951:0:14450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788909287.233968:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc11800/0x733cfdd8721d6613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d661a expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.233976:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89052dc11800/0x733cfdd8721d6613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d661a expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909287.233995:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788909287.234000:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788909287.234004:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89053c610000 10000000:01000000:1.0:1788909287.234007:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788909287.234009:0:14450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788909287.234012:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788909287.234033:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c769c00/0x733cfdd8721d6621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.234040:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c769c00/0x733cfdd8721d6621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.234048:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c769c00/0x733cfdd8721d6621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909287.234065:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788909287.234097:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.238793:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019547392 00000100:00100000:2.0:1788909287.238810:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019547392 00000100:00100000:2.0:1788909287.238890:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788909287.238902:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+7:14450:x1875807019547392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788909287.238920:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909287.238954:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d6628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d6621 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.239065:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d6628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d6621 expref: 8 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.239077:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc10c00/0x733cfdd8721d6628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d6621 expref: 8 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.239106:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10c00, rc 0) 00000100:00100000:2.0:1788909287.239201:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+8:14450:x1875807019547392:12345-0@lo:101:mount.lustre.0 Request processed in 302us (5102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909287.239209:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788909287.239314:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506131c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.239414:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909287.239433:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c769c00/0x733cfdd8721d6621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6628 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.239443:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c769c00/0x733cfdd8721d6621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d6628 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909287.239577:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909287.239614:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909287.239797:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506a6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788909287.239843:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019547520 00000100:00100000:2.0:1788909287.239849:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019547520 00000100:00100000:2.0:1788909287.239921:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788909287.239928:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+8:14450:x1875807019547520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909287.240967:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+9:14450:x1875807019547520:12345-0@lo:501:mount.lustre.0 Request processed in 1036us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.240978:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788909287.241100:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788909287.241249:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788909287.241295:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.241321:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909287.242599:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019547648 00000100:00100000:0.0:1788909287.242611:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019547648 00000100:00100000:0.0:1788909287.242871:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788909287.242884:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+9:14450:x1875807019547648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788909287.244278:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+9:14450:x1875807019547648:12345-0@lo:503:mount.lustre.0 Request processed in 1391us (2976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909287.244290:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788909287.244423:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019547648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788909287.248438:0:14485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14485:1875807019547776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909287.248533:0:14485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.249594:0:14485:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.249843:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019547776 00000100:00100000:3.0:1788909287.249853:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019547776 00000100:00100000:3.0:1788909287.249967:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788909287.249977:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+9:14485:x1875807019547776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909287.250393:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+9:14485:x1875807019547776:12345-0@lo:502:llog_process_th.0 Request processed in 416us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.250403:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788909287.250500:0:14485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14485:1875807019547776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788909287.250536:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788909287.250547:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788909287.250550:0:14485:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788909287.250555:0:14485:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788909287.250558:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788909287.250572:0:14485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89052e903370) 00000020:00000080:1.0:1788909287.250588:0:14485:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788909287.250593:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788909287.250700:0:14485:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788909287.250707:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d6636 00000020:00000080:1.0:1788909287.250913:0:14485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788909287.250917:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788909287.250920:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788909287.250922:0:14485:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788909287.250924:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788909287.250927:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788909287.250929:0:14485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788909287.250931:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788909287.250950:0:14485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89052e900000) 00000020:00000080:1.0:1788909287.250960:0:14485:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788909287.250963:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788909287.250965:0:14485:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788909287.250968:0:14485:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788909287.250973:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788909287.251010:0:14485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89053c610000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788909287.251031:0:14485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89053c67b370) 00000020:00000080:1.0:1788909287.251039:0:14485:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788909287.251098:0:14485:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788909287.251104:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d664b 00000020:00000080:1.0:1788909287.251207:0:14485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788909287.251213:0:14485:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788909287.251217:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x733cfdd8721d6652 00080000:01000000:1.0:1788909287.251222:0:14485:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788909287.251224:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d6659 00010000:00010000:0.0:1788909287.313521:0:14485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788909287.314234:0:14485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1788909287.314475:0:14485:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788909287.315191:0:14485:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff890518374d28) 00000020:00000080:0.0:1788909287.315225:0:14485:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788909287.315304:0:14485:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788909287.315313:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d6667 00000020:00000080:1.0:1788909287.315872:0:14485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788909287.331391:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x733cfdd8721d666e 00000020:00000080:3.0:1788909287.331589:0:14485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788909287.331601:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909287.331606:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.331609:0:14485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788909287.331612:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788909287.331614:0:14485:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788909287.331622:0:14485:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788909287.331624:0:14485:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788909287.331639:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788909287.331642:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.331643:0:14485:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788909287.331646:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909287.331650:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.331652:0:14485:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788909287.331655:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788909287.331690:0:14485:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788909287.331703:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909287.331706:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.331707:0:14485:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788909287.331710:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788909287.331712:0:14485:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788909287.331715:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.331716:0:14485:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788909287.331719:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788909287.331724:0:14485:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:3.0:1788909287.331747:0:14485:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788909287.331750:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788909287.331764:0:14485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89053cc519b8) 00000020:00000080:3.0:1788909287.331776:0:14485:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788909287.331780:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788909287.331831:0:14485:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788909287.331837:0:14485:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788909287.331842:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d667c 00010000:00080000:3.0:1788909287.331869:0:14485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89052747d000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788909287.332100:0:14485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788909287.332434:0:14485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788909287.332481:0:14485:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788909287.341614:0:14485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788909287.342367:0:14485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788909287.342442:0:14485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788909287.344760:0:14489:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788909287.344767:0:14489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788909287.345377:0:14485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788909287.345391:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788909287.345426:0:14485:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788909287.345446:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d6683 00000100:00080000:2.0:1788909287.345457:0:14485:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788909287.345463:0:14485:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89052747d000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788909287.345498:0:14485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89052df6c700 x1875807019547904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788909287.345581:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019547904:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788909287.345728:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875807019547904 offset 0 length 520: 4 00000100:00080000:2.0:1788909287.345861:0:14485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788909287.345922:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909287.345927:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909287.345929:0:14485:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788909287.345942:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788909287.345946:0:14485:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788909287.345948:0:14485:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788909287.345949:0:14485:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788909287.345951:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788909287.345953:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909287.345956:0:14485:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788909287.345958:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788909287.345962:0:14485:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788909287.345965:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909287.345966:0:14485:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788909287.345969:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788909287.345973:0:14485:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:2.0:1788909287.345997:0:14485:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788909287.346000:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788909287.346013:0:14485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8905347e0000) 00000020:00000080:2.0:1788909287.346026:0:14485:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788909287.346031:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788909287.346145:0:14485:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788909287.346152:0:14485:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788909287.346161:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x733cfdd8721d6691 00010000:00080000:2.0:1788909287.346194:0:14485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8905344ac000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788909287.346444:0:14485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788909287.347319:0:14485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788909287.347349:0:14485:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788909287.348557:0:14485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788909287.348726:0:14485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788909287.348812:0:14485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788909287.349340:0:14491:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788909287.349346:0:14491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788909287.350081:0:14485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788909287.350093:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788909287.350326:0:14485:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788909287.350346:0:14485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d6698 00000100:00080000:2.0:1788909287.350357:0:14485:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788909287.350363:0:14485:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8905344ac000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788909287.350396:0:14485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89052df6ea00 x1875807019548032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788909287.350451:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019548032:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788909287.350505:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875807019548032 offset 0 length 520: 4 00000100:00080000:2.0:1788909287.350563:0:14485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788909287.350751:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909287.350757:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909287.350759:0:14485:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788909287.350764:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788909287.350768:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909287.350770:0:14485:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788909287.350773:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788909287.350774:0:14485:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788909287.350777:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909287.350779:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909287.350780:0:14485:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788909287.350783:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788909287.350785:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909287.350787:0:14485:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788909287.350790:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788909287.350819:0:14485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14485:1875807019548160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909287.350871:0:14485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.350898:0:14485:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.350967:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019548160 00000100:00100000:3.0:1788909287.350975:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019548160 00000100:00100000:3.0:1788909287.351021:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788909287.351030:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+9:14485:x1875807019548160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909287.351293:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+9:14485:x1875807019548160:12345-0@lo:502:llog_process_th.0 Request processed in 263us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.351301:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788909287.351405:0:14485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14485:1875807019548160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788909287.351431:0:14485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909287.351440:0:14485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909287.351442:0:14485:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788909287.351446:0:14485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788909287.351581:0:14450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788909287.351604:0:14450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788909287.351633:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c769c00/0x733cfdd8721d6621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6628 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.351645:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c769c00/0x733cfdd8721d6621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6628 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909287.351653:0:14450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89053c610000 from 1 10000000:01000000:3.0:1788909287.351656:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788909287.351682:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.351691:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.351700:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909287.351713:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788909287.351750:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909287.351773:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890533d25240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.351790:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019548288 00000100:00100000:3.0:1788909287.351794:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019548288 00000100:00100000:3.0:1788909287.351816:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788909287.351823:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+9:14450:x1875807019548288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909287.351831:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909287.351844:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d669f expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.351863:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d669f expref: 10 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.351873:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d669f expref: 10 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.351882:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6a00, rc 0) 00000100:00100000:3.0:1788909287.351910:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+10:14450:x1875807019548288:12345-0@lo:101:mount.lustre.0 Request processed in 87us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.351916:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788909287.351960:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909287.351971:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.351980:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909287.352535:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548416:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788909287.352575:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909287.352596:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890533d25240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.352613:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019548416 00000100:00100000:3.0:1788909287.352616:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019548416 00000100:00100000:3.0:1788909287.352640:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788909287.352646:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+10:14450:x1875807019548416:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788909287.352659:0:14460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788909287.352664:0:14460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788909287.352718:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+10:14450:x1875807019548416:12345-0@lo:256:mount.lustre.0 Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.352725:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788909287.352756:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548416:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788909287.353355:0:14450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788909287.353363:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.353372:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909287.353380:0:14450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89053c610000 from 1 10000000:01000000:3.0:1788909287.353382:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788909287.353403:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.353410:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.353418:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909287.353440:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788909287.353468:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909287.353493:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890503960240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.353509:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019548544 00000100:00100000:3.0:1788909287.353513:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019548544 00000100:00100000:3.0:1788909287.353539:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788909287.353545:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+10:14450:x1875807019548544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909287.353552:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909287.353562:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d66ad expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.353580:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d66ad expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.353588:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d66ad expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.353595:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6800, rc 0) 00000100:00100000:3.0:1788909287.353623:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14450:x1875807019548544:12345-0@lo:101:mount.lustre.0 Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.353629:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788909287.353665:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909287.353675:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.353684:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909287.353735:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909287.353759:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909287.353771:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890503960240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.353782:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019548672 00000100:00100000:3.0:1788909287.353786:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019548672 00000100:00100000:3.0:1788909287.353805:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788909287.353810:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14450:x1875807019548672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909287.354208:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14450:x1875807019548672:12345-0@lo:501:mount.lustre.0 Request processed in 396us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.354216:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788909287.354249:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909287.354274:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788909287.354312:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909287.354331:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890503960240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.354342:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019548800 00000100:00100000:3.0:1788909287.354346:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019548800 00000100:00100000:3.0:1788909287.354365:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788909287.354371:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14450:x1875807019548800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788909287.355021:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14450:x1875807019548800:12345-0@lo:503:mount.lustre.0 Request processed in 647us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.355029:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788909287.355097:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019548800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788909287.355723:0:14493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14493:1875807019548928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909287.355764:0:14493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.355829:0:14493:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788909287.355863:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019548928 00000100:00100000:0.0:1788909287.355868:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019548928 00000100:00100000:0.0:1788909287.355929:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788909287.355954:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14493:x1875807019548928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788909287.356176:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14493:x1875807019548928:12345-0@lo:502:llog_process_th.0 Request processed in 224us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909287.356183:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788909287.356267:0:14493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14493:1875807019548928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909287.356289:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909287.356301:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.356304:0:14493:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788909287.356311:0:14493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89053c610000 00000020:00000080:3.0:1788909287.356313:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788909287.356321:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909287.356323:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.356324:0:14493:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788909287.356327:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909287.356329:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.356330:0:14493:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788909287.356333:0:14493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89053c610000 00000020:00000080:3.0:1788909287.356335:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788909287.356394:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909287.356398:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.356399:0:14493:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788909287.356401:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909287.356404:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.356405:0:14493:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788909287.356409:0:14493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89053c610000 00000020:00000080:3.0:1788909287.356411:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788909287.356446:0:14493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14493:1875807019549056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909287.356480:0:14493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.359829:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019549056 00000100:00100000:2.0:1788909287.359843:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019549056 00000100:00100000:2.0:1788909287.359888:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788909287.359897:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14493:x1875807019549056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909287.360160:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14493:x1875807019549056:12345-0@lo:502:llog_process_th.0 Request processed in 263us (3678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909287.360167:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788909287.365795:0:14493:0:(client.c:2715:ptlrpc_set_wait()) set ffff890510ada000 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.365840:0:14493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14493:1875807019549056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788909287.365881:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909287.365889:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909287.365891:0:14493:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788909287.365896:0:14493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788909287.366279:0:14450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788909287.366302:0:14450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788909287.366363:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909287.366374:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909287.366423:0:14450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788909287.366426:0:14450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89053c610000 10000000:01000000:0.0:1788909287.366429:0:14450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89053c610000 10000000:01000000:0.0:1788909287.366433:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788909287.366439:0:14450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89053c610000 from 1 10000000:01000000:0.0:1788909287.366442:0:14450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788909287.366477:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c516000/0x733cfdd8721d66bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909287.366486:0:14450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c516000/0x733cfdd8721d66bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909287.366496:0:14450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c516000/0x733cfdd8721d66bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909287.366518:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019549184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788909287.366580:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.366774:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019549184 00000100:00100000:2.0:1788909287.366781:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019549184 00000100:00100000:2.0:1788909287.366826:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788909287.366835:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14450:x1875807019549184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788909287.366848:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909287.366860:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc10a00/0x733cfdd8721d66c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d66bb expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.366882:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10a00/0x733cfdd8721d66c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d66bb expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.366892:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc10a00/0x733cfdd8721d66c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d66bb expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909287.366900:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10a00, rc 0) 00000100:00100000:2.0:1788909287.366946:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14450:x1875807019549184:12345-0@lo:101:mount.lustre.0 Request processed in 111us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909287.366958:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788909287.367742:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506bdc600 going to sleep for 11 seconds 00000100:00100000:0.0:1788909287.367771:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019549184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788909287.367789:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c516000/0x733cfdd8721d66bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66c2 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909287.367800:0:14450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c516000/0x733cfdd8721d66bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d66c2 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909287.367865:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019549312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788909287.367908:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909287.367973:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506bdc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788909287.369384:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019549312 00000100:00100000:1.0:1788909287.369395:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019549312 00000100:00100000:1.0:1788909287.369450:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788909287.369460:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14450:x1875807019549312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788909287.369840:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14450:x1875807019549312:12345-0@lo:501:mount.lustre.0 Request processed in 380us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909287.369854:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788909287.370011:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019549312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788909287.370054:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019549440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788909287.370097:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909287.370138:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909287.370151:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019549440 00000100:00100000:1.0:1788909287.370155:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019549440 00000100:00100000:1.0:1788909287.370176:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788909287.370181:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14450:x1875807019549440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788909287.370319:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14450:x1875807019549440:12345-0@lo:503:mount.lustre.0 Request processed in 137us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909287.370326:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788909287.370370:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019549440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788909287.374211:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14498:1875807019549568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909287.374293:0:14498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.374337:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.374398:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019549568 00000100:00100000:3.0:1788909287.374407:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019549568 00000100:00100000:3.0:1788909287.374457:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788909287.374466:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14498:x1875807019549568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788909287.377014:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14498:x1875807019549568:12345-0@lo:502:llog_process_th.0 Request processed in 2534us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909287.377033:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788909287.377548:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14498:1875807019549568:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788909287.377712:0:14498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788909287.377730:0:14498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8905347e3370) 00000020:00000080:2.0:1788909287.377754:0:14498:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788909287.377864:0:14498:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89053c610000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788909287.377869:0:14498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89053c610000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788909287.377872:0:14498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89053c610000 4 00010000:00080000:2.0:1788909287.377902:0:14498:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8905068db000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788909287.384460:0:14498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788909287.387061:0:14498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788909287.387098:0:14498:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788909287.387126:0:14498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x733cfdd8721d66d0 00000100:00080000:2.0:1788909287.387136:0:14498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788909287.387143:0:14498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8905068db000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788909287.387178:0:14498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89052df6ca80 x1875807019549696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788909287.387223:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019549696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788909287.387298:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788909287.387349:0:14498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788909287.387610:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019549696 00000100:00100000:3.0:1788909287.387620:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019549696 00000100:00100000:3.0:1788909287.387668:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788909287.387675:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875807019549696:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788909287.387735:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875807019549696:12345-0@lo:38:llog_process_th.0 Request processed in 59us (437us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788909287.387743:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909287.389228:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788909287.389242:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8905068db000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788909287.389248:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788909287.389260:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019549696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788909287.389422:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14498:1875807019549824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909287.389493:0:14498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909287.389533:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019549824 00000100:00100000:2.0:1788909287.389539:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019549824 00000100:00100000:2.0:1788909287.389583:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788909287.389592:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14498:x1875807019549824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788909287.391845:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14498:x1875807019549824:12345-0@lo:502:llog_process_th.0 Request processed in 2246us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909287.391858:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788909287.391946:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788909287.391970:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af89eede-3fcd-45ad-88b4-973cc21df0c9:14498:1875807019549824:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788909287.392007:0:14498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788909287.392769:0:14450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788909287.392798:0:14450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788909287.392815:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c516000/0x733cfdd8721d66bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66c2 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909287.392827:0:14450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c516000/0x733cfdd8721d66bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66c2 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788909287.392873:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788909287.392875:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788909287.392877:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788909287.392878:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788909287.392879:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788909287.392880:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788909287.392881:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788909287.392883:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788909287.392884:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788909287.392885:0:14450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788909287.392888:0:14450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788909287.392890:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788909287.392891:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788909287.392896:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788909287.392897:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788909287.392897:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788909287.392898:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788909287.392899:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788909287.392900:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788909287.392901:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788909287.392901:0:14450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788909287.392922:0:14450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788909287.392951:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019549952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788909287.393001:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909287.393030:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff890510ada240 going to sleep for 11 seconds 00000100:00100000:3.0:1788909287.393059:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019549952 00000100:00100000:3.0:1788909287.393066:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019549952 00000100:00100000:3.0:1788909287.393105:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788909287.393144:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14450:x1875807019549952:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788909287.393182:0:14463:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788909287.393195:0:14463:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788909287.433190:0:14463:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788909287.433203:0:14463:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788909287.433592:0:14483:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788909287.433598:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788909287.433635:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.433654:0:14483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d669f expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.433663:0:14483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.433716:0:14483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d669f expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.433748:0:14483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d669f expref: 12 pid: 14462 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909287.433763:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14483:1875807019550080:0@lo:104: 00000100:00100000:1.0:1788909287.433836:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909287.433879:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788909287.433948:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019550080 00000100:00100000:1.0:1788909287.433959:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019550080 00000100:00100000:1.0:1788909287.434008:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788909287.434017:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:14483:x1875807019550080:12345-0@lo:104: 00010000:00010000:1.0:1788909287.434030:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434088:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788909287.434094:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:14483:x1875807019550080:12345-0@lo:104: Request processed in 79us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909287.434100:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788909287.434151:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909287.434157:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434164:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6600 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:1.0:1788909287.434169:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434177:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788909287.434196:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909287.434201:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788909287.434234:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434241:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788909287.434260:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434267:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d669f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d66a6 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434281:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909287.434283:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909287.434285:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909287.434318:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019550208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909287.434348:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909287.434415:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019550208 00000100:00100000:1.0:1788909287.434420:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019550208 00010000:00010000:1.0:1788909287.434437:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d669f expref: 13 pid: 14462 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909287.434458:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788909287.434464:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+13:3285:x1875807019550208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788909287.434475:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909287.434480:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d669f expref: 13 pid: 14462 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434496:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d669f expref: 13 pid: 14462 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434512:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434519:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788909287.434533:0:14453:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000935657s 00010000:00010000:1.0:1788909287.434537:0:14453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434544:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434551:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434557:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434562:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909287.434567:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434574:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434582:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434598:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909287.434629:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+13:3285:x1875807019550208:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909287.434636:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788909287.434671:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019550208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788909287.434698:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8905180a6a00/0x733cfdd8721d66a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d669f expref: 12 pid: 14462 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909287.434707:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14483:1875807019550080:0@lo:104: 00010000:00010000:1.0:1788909287.434718:0:14483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434726:0:14483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434732:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909287.434738:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89053c769800/0x733cfdd8721d66d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909287.443523:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14450:x1875807019549952:12345-0@lo:253:mount.lustre.0 Request processed in 50366us (50505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909287.443540:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788909287.443684:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:14450:1875807019549952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788909287.443701:0:14450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788909287.443705:0:14450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788909287.443707:0:14450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788909287.443708:0:14450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909287.443709:0:14450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909287.443711:0:14450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909287.443712:0:14450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909287.443714:0:14450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788909287.443715:0:14450:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788909287.443717:0:14450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909287.443719:0:14450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788909287.443736:0:14450:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788909287.447976:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909287.448204:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909287.448499:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909287.449281:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909287.449598:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909287.450054:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788909287.451419:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788909287.451599:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788909287.451982:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788909287.452231:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788909287.452512:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788909287.453008:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788909287.475106:0:14450:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788909287.475733:0:14450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788909287.477977:0:14450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788909287.478140:0:14450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788909287.478962:0:14506:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788909287.478968:0:14506:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:1.0:1788909287.479054:0:14450:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788909287.479064:0:14450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:01000000:2.0:1788909287.479175:0:14507:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788909287.479254:0:14507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788909287.481593:0:14507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788909287.482273:0:14507:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788909287.482279:0:14507:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788909287.482753:0:14450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788909287.484033:0:14450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788909287.486538:0:14450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788909287.486628:0:14450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788909287.489918:0:14450:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788909287.495439:0:14450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788909287.533555:0:14450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788909287.533593:0:14450:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa608c1cb7988 00100000:10000000:2.0:1788909287.533602:0:14450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788909287.534337:0:14450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788909287.534352:0:14450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788909287.534366:0:14450:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788909287.534463:0:14450:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788909288.008537:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788909288.197241:0:14465:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788909288.197249:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89053c610000 from 6 10000000:01000000:1.0:1788909288.197255:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788909288.197369:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909288.197382:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909288.197394:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909288.197420:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019550336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788909288.197548:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909288.197657:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788909288.209238:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019550336 00000100:00100000:2.0:1788909288.209257:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019550336 00000100:00100000:2.0:1788909288.209546:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788909288.209564:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14465:x1875807019550336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909288.209586:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909288.209615:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d66de expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909288.209677:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d66de expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909288.209691:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d66de expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909288.209702:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909288.209812:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14465:x1875807019550336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (12255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909288.209820:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788909288.211084:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019550336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788909288.211122:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909288.211135:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909288.211205:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019550464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788909288.211257:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909288.211302:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788909288.211621:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019550464 00000100:00100000:2.0:1788909288.211629:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019550464 00000100:00100000:2.0:1788909288.211679:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788909288.211688:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14465:x1875807019550464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788909288.211706:0:14463:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788909288.211723:0:14463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788909288.211726:0:14463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788909288.211805:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14465:x1875807019550464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909288.211813:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788909288.211901:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019550464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788909288.211974:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788909288.211984:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909288.211993:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788909288.459385:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788909289.030980:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788909289.477747:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788909290.054194:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909291.084181:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788909291.422246:0:14749:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788909292.106693:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788909292.677456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788909292.677463:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788909292.677466:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788909292.677469:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788909292.677472:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788909292.677475:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788909292.677479:0:8:0:(import.c:65:import_set_state_nolock()) ffff8905068db000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788909292.677493:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8905068db000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788909292.677516:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8905342a4e00 x1875807019550720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788909292.677574:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af89eede-3fcd-45ad-88b4-973cc21df0c9:3286:1875807019550592:0@lo:400:kworker.0 00000100:00100000:1.0:1788909292.677654:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909292.677719:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019550720:0@lo:38:kworker.0 00000100:00100000:1.0:1788909292.677764:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909292.677809:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019550592 00000100:00100000:1.0:1788909292.677817:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019550592 00000100:00100000:1.0:1788909292.677877:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788909292.677886:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:3286:x1875807019550592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909292.677938:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:3286:x1875807019550592:12345-0@lo:400:kworker.0 Request processed in 54us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909292.677946:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788909292.677995:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af89eede-3fcd-45ad-88b4-973cc21df0c9:3286:1875807019550592:0@lo:400:kworker.0 00000100:00100000:0.0:1788909292.678098:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019550720 00000100:00100000:0.0:1788909292.678103:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019550720 00000100:00100000:0.0:1788909292.678154:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788909292.678160:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875807019550720:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788909292.678183:0:14469:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 374 last 0 00000020:00000080:0.0:1788909292.678220:0:14469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x733cfdd8721d66ec 00000004:00100000:0.0:1788909292.678237:0:14469:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788909292.678379:0:14469:0:(import.c:65:import_set_state_nolock()) ffff890537b25000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788909292.678433:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875807019550720:12345-0@lo:38:kworker.0 Request processed in 272us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909292.678440:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788909292.679070:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8905342a4e00 x1875807019550720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788909302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788909292.679089:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788909292.679098:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788909292.679104:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788909292.679133:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8905068db000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788909292.679142:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875807019550720:0@lo:38:kworker.0 00010000:00010000:1.0:1788909293.125246:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909294.149954:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788909294.268665:0:14900:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3d8982d0 20000000:00000080:2.0:1788909294.268687:0:14900:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89053dccd800 uarg=0000000000000000 20000000:01000000:2.0:1788909294.268726:0:14900:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788909294.268734:0:14900:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788909294.268741:0:14900:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788909294.269661:0:14901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788909294.269845:0:14900:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788909294.277351:0:14900:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788909294.277387:0:14900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909294.277407:0:14900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d66ad expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909294.277416:0:14900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909294.277482:0:14900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d66ad expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909294.277512:0:14900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d66ad expref: 11 pid: 14460 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909294.277530:0:14900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14900:1875807019550848:0@lo:104: 00000100:00100000:2.0:1788909294.277614:0:14900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909294.277677:0:14900:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909294.277841:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019550848 00000100:00100000:1.0:1788909294.277850:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019550848 00000100:00100000:1.0:1788909294.277905:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788909294.277916:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:14900:x1875807019550848:12345-0@lo:104: 00010000:00010000:1.0:1788909294.277929:0:14452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.277998:0:14452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788909294.278005:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:14900:x1875807019550848:12345-0@lo:104: Request processed in 91us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909294.278025:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788909294.278049:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909294.278055:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278062:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:1.0:1788909294.278067:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278076:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788909294.278083:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909294.278090:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788909294.278150:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278158:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788909294.278180:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278187:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8905180a6200/0x733cfdd8721d66ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d66b4 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278204:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909294.278206:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909294.278208:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909294.278246:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019550976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909294.278286:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909294.278323:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019550976 00000100:00100000:1.0:1788909294.278327:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019550976 00010000:00010000:1.0:1788909294.278344:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d66ad expref: 12 pid: 14460 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909294.278366:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788909294.278372:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:3283:x1875807019550976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788909294.278382:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909294.278387:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d66ad expref: 12 pid: 14460 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278396:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d66ad expref: 12 pid: 14460 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278411:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278418:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278431:0:14453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278437:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278444:0:14453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278450:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278466:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909294.278471:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278479:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278488:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909294.278640:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909294.278705:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:3283:x1875807019550976:12345-0@lo:103:ldlm_bl.0 Request processed in 332us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909294.278713:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788909294.278836:0:14900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8905180a6800/0x733cfdd8721d66b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d66ad expref: 11 pid: 14460 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909294.278848:0:14900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14900:1875807019550848:0@lo:104: 00010000:00010000:3.0:1788909294.278867:0:14900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909294.278886:0:14900:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909294.278892:0:14900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909294.278899:0:14900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc10800/0x733cfdd8721d66f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909294.286395:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019550976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909295.173558:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788909296.008238:0:14465:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788909296.008246:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89053c610000 from 10 10000000:01000000:1.0:1788909296.008252:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788909296.008299:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909296.008311:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909296.008322:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909296.008347:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019551104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788909296.008416:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909296.008473:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905085a8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788909296.008545:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019551104 00000100:00100000:2.0:1788909296.008552:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019551104 00000100:00100000:2.0:1788909296.008606:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788909296.008616:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+11:14465:x1875807019551104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909296.008638:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909296.008651:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d66fa expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909296.008674:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d66fa expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909296.008684:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d66fa expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909296.008695:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10400, rc 0) 00000100:00100000:2.0:1788909296.008747:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14465:x1875807019551104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909296.008761:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788909296.008863:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019551104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909296.008881:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909296.008891:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909296.008955:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019551232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909296.008987:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909296.009028:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890507c94d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788909296.009043:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019551232 00000100:00100000:2.0:1788909296.009049:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019551232 00000100:00100000:2.0:1788909296.009085:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788909296.009093:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14465:x1875807019551232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909296.009373:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14465:x1875807019551232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909296.009381:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788909296.009418:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019551232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788909296.009455:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019551360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788909296.009658:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909296.009691:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788909296.009751:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019551360 00000100:00100000:2.0:1788909296.009756:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019551360 00000100:00100000:2.0:1788909296.009798:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788909296.009804:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14465:x1875807019551360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909296.009964:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:14465:x1875807019551360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909296.009971:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788909296.010168:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019551360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788909296.013131:0:14969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788909296.013746:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788909296.013788:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788909296.013802:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909296.013816:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909296.198328:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909297.221361:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909297.797367:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788909287/real 1788909287] req@ffff89052df6ea00 x1875807019548032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788909297 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909297.797398:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89052df6ea00 x1875807019548032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788909297 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909297.797408:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788909287/real 1788909287] req@ffff89052df6c700 x1875807019547904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788909297 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909297.797420:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89052df6c700 x1875807019547904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788909297 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788909297.797583:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8905344ac000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788909297.797606:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788909297.797610:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019548032:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788909297.797616:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89052747d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788909297.797621:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788909297.797624:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019547904:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788909297.797858:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788909297.797863:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788909297.797866:0:8:0:(import.c:65:import_set_state_nolock()) ffff89052747d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788909297.797871:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 369 00000100:00080000:1.0:1788909297.797876:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788909297.797883:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89052747d000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788909297.797902:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8905342a4000 x1875807019551616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788909297.797912:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788909297.797916:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788909297.797917:0:8:0:(import.c:65:import_set_state_nolock()) ffff8905344ac000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788909297.797921:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 369 00000100:00080000:1.0:1788909297.797923:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788909297.797927:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8905344ac000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788909297.797936:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8905342a6300 x1875807019551744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788909297.797977:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019551872:0@lo:400:kworker.0 00000100:00100000:1.0:1788909297.798036:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909297.798510:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788909297.798520:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019551488:0@lo:400:kworker.0 00000100:00100000:0.0:1788909297.798557:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909297.798612:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019551872 00000100:00100000:0.0:1788909297.798620:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019551872 00000100:00100000:0.0:1788909297.798744:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788909297.798755:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019551872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909297.798807:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019551872:12345-0@lo:400:kworker.0 Request processed in 54us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909297.798815:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909297.799575:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019551488 00000100:00100000:2.0:1788909297.799583:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019551488 00000100:00100000:2.0:1788909297.799625:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788909297.799634:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:3283:x1875807019551488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909297.799768:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:3283:x1875807019551488:12345-0@lo:400:kworker.0 Request processed in 136us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909297.799776:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788909297.800180:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8905342a6a00 x1875807019551872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909297.800195:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019551872:0@lo:400:kworker.0 00000100:00100000:1.0:1788909297.800297:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019551616:0@lo:8:kworker.0 00000400:00000100:1.0:1788909297.800340:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875807019551616 offset 0 length 520: 4 00000100:00100000:1.0:1788909297.800519:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019551744:0@lo:8:kworker.0 00000400:00000100:1.0:1788909297.800541:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875807019551744 offset 0 length 520: 4 00000100:00100000:0.0:1788909297.801352:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019551488:0@lo:400:kworker.0 00010000:00010000:1.0:1788909298.246210:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788909298.876100:0:15151:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788909298.876104:0:15151:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788909298.876722:0:15151:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff890537b24800 00000020:01000004:0.0:1788909298.876740:0:15151:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788909298.876753:0:15151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788909298.876768:0:15151:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff890518373370) 00000020:00000080:0.0:1788909298.876786:0:15151:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788909298.910227:0:15151:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788909298.910739:0:15151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788909298.911681:0:15151:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788909298.911931:0:15151:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788909298.912213:0:15151:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788909298.913855:0:15151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 412: rc = 0 00100000:10000000:3.0:1788909298.914025:0:15151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 412: rc = 0 00100000:10000000:3.0:1788909298.914148:0:15151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 412: rc = 0 00100000:10000000:3.0:1788909298.917438:0:15151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 678: rc = 0 00100000:10000000:3.0:1788909298.917839:0:15151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 678: rc = 0 00100000:10000000:3.0:1788909298.918090:0:15151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 678: rc = 0 00100000:10000000:3.0:1788909298.918380:0:15151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 678: rc = 0 00100000:10000000:3.0:1788909298.918613:0:15151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 678: rc = 0 00100000:10000000:3.0:1788909298.918876:0:15151:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 678: rc = 0 00000020:00000080:3.0:1788909298.923736:0:15151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788909298.923751:0:15151:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788909298.923765:0:15151:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x733cfdd8721d670f 00000020:01000004:3.0:1788909298.923776:0:15151:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788909298.923799:0:15151:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788909298.923803:0:15151:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788909298.923810:0:15151:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788909298.923814:0:15151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788909298.923826:0:15151:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89053cc50000) 00000020:00000080:3.0:1788909298.923836:0:15151:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788909298.930553:0:15151:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788909298.930770:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788909298.930776:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788909298.932071:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788909298.932079:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788909298.932700:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788909298.932730:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788909298.937953:0:15151:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909298.938309:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788909298.938316:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788909298.940014:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788909298.940025:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788909298.959926:0:15151:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788909298.960309:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788909298.960316:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788909298.961583:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788909298.961595:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788909298.963483:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788909298.963496:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788909298.965250:0:15151:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788909298.965452:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788909298.965458:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788909298.966045:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788909298.966052:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788909298.994634:0:15151:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788909298.994883:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788909298.994889:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788909298.996106:0:15151:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788909298.996213:0:15151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788909298.997611:0:15151:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788909298.997640:0:15151:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788909298.997646:0:15151:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788909299.020104:0:15151:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788909299.020377:0:15151:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788909299.020381:0:15151:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788909299.020383:0:15151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788909299.020384:0:15151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909299.020385:0:15151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909299.020386:0:15151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909299.020387:0:15151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909299.020389:0:15151:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909299.020390:0:15151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909299.020392:0:15151:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788909299.020395:0:15151:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788909299.020398:0:15151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788909299.020399:0:15151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788909299.020400:0:15151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909299.020402:0:15151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909299.020403:0:15151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909299.020404:0:15151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909299.020405:0:15151:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909299.020406:0:15151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909299.020407:0:15151:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788909299.020434:0:15151:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788909299.020454:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788909299.020526:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909299.020889:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788909299.020986:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019552000 00000100:00100000:1.0:1788909299.020995:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019552000 00000100:00100000:1.0:1788909299.021086:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788909299.021096:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:15151:x1875807019552000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788909299.021146:0:14460:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788909299.021150:0:14460:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788909299.021153:0:14460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788909299.028028:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:15151:x1875807019552000:12345-0@lo:253:mount.lustre.0 Request processed in 6923us (7492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909299.028043:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788909299.028252:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788909299.028267:0:15151:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788909299.028270:0:15151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788909299.028283:0:15151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788909299.028285:0:15151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909299.028286:0:15151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909299.028287:0:15151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909299.028289:0:15151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909299.028290:0:15151:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909299.028292:0:15151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909299.028294:0:15151:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788909299.028473:0:15151:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890537b24800 from lustre-OST0000 10000000:01000000:3.0:1788909299.028502:0:15151:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788909299.028505:0:15151:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788909299.028513:0:15151:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89052e904d28 local copy 00010000:00010000:3.0:1788909299.028525:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909299.028845:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909299.028901:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.029009:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502bf6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788909299.029051:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019552128 00000100:00100000:1.0:1788909299.029059:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019552128 00000100:00100000:1.0:1788909299.029178:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788909299.029188:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:15151:x1875807019552128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788909299.029343:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:15151:x1875807019552128:12345-0@lo:501:mount.lustre.0 Request processed in 157us (441us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788909299.029352:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788909299.029428:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552128:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788909299.029444:0:15151:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788909299.029593:0:15151:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788909299.029602:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.029611:0:15151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909299.029632:0:15151:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890537b24800 10000000:01000000:3.0:1788909299.029637:0:15151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788909299.029643:0:15151:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89052e904d28 10000000:01000000:3.0:1788909299.029646:0:15151:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788909299.029650:0:15151:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff89052e904d28 from 1 10000000:01000000:3.0:1788909299.029652:0:15151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788909299.029677:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6a00/0x733cfdd8721d671d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.029686:0:15151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8905180a6a00/0x733cfdd8721d671d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.029696:0:15151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8905180a6a00/0x733cfdd8721d671d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909299.029736:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788909299.029766:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.032055:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502bf6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788909299.032176:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019552256 00000100:00100000:2.0:1788909299.032185:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019552256 00000100:00100000:2.0:1788909299.032236:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788909299.032246:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+12:15151:x1875807019552256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788909299.032261:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909299.032280:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc11000/0x733cfdd8721d6724 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d671d expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.032306:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc11000/0x733cfdd8721d6724 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d671d expref: 13 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.032317:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc11000/0x733cfdd8721d6724 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d671d expref: 13 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.032328:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11000, rc 0) 00000100:00100000:2.0:1788909299.032387:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+13:15151:x1875807019552256:12345-0@lo:101:mount.lustre.0 Request processed in 142us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909299.032395:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788909299.032511:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909299.032529:0:15151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8905180a6a00/0x733cfdd8721d671d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6724 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.032540:0:15151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8905180a6a00/0x733cfdd8721d671d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d6724 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909299.032562:0:15151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788909299.032575:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6a00/0x733cfdd8721d671d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6724 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.032583:0:15151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8905180a6a00/0x733cfdd8721d671d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6724 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909299.032591:0:15151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788909299.032596:0:15151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788909299.032602:0:15151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788909299.032604:0:15151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788909299.032626:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6800/0x733cfdd8721d672b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.032634:0:15151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8905180a6800/0x733cfdd8721d672b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.032643:0:15151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8905180a6800/0x733cfdd8721d672b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909299.032675:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788909299.032731:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.032749:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502bf6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788909299.032869:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019552384 00000100:00100000:2.0:1788909299.032874:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019552384 00000100:00100000:2.0:1788909299.032891:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788909299.032898:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+13:15151:x1875807019552384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788909299.032905:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909299.032920:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc10800/0x733cfdd8721d6732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d672b expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.032935:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc10800/0x733cfdd8721d6732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d672b expref: 14 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.032943:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc10800/0x733cfdd8721d6732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d672b expref: 14 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.032950:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc10800, rc 0) 00000100:00100000:2.0:1788909299.033073:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019552384:12345-0@lo:101:mount.lustre.0 Request processed in 174us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909299.033080:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788909299.033378:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909299.033390:0:15151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8905180a6800/0x733cfdd8721d672b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6732 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.033399:0:15151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8905180a6800/0x733cfdd8721d672b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d6732 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788909299.034265:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788909299.035300:0:15151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788909299.035818:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788909299.035862:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788909299.035894:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788909299.035939:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788909299.035978:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788909299.036013:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788909299.036100:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788909299.036277:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788909299.036364:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909299.036439:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.036485:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511848c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788909299.036605:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019552512 00000100:00100000:0.0:1788909299.036613:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019552512 00000100:00100000:0.0:1788909299.036662:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788909299.036672:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019552512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788909299.037063:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019552512:12345-0@lo:501:mount.lustre.0 Request processed in 392us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909299.037071:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788909299.037263:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909299.037295:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788909299.037336:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.037371:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511848c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788909299.037430:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019552640 00000100:00100000:0.0:1788909299.037435:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019552640 00000100:00100000:0.0:1788909299.037471:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788909299.037479:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019552640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788909299.037768:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019552640:12345-0@lo:503:mount.lustre.0 Request processed in 289us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909299.037776:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788909299.037924:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552640:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788909299.038766:0:15151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788909299.038846:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788909299.038895:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.038922:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511848c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788909299.039056:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019552768 00000100:00100000:1.0:1788909299.039063:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019552768 00000100:00100000:1.0:1788909299.039141:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788909299.039149:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019552768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788909299.039341:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019552768:12345-0@lo:502:mount.lustre.0 Request processed in 192us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909299.039348:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788909299.039566:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788909299.039788:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788909299.039834:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788909299.039867:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788909299.039916:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788909299.039951:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788909299.039983:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788909299.040032:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788909299.040070:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788909299.040106:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788909299.040178:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788909299.040210:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788909299.040265:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788909299.040297:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788909299.040339:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.040375:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511848c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788909299.040537:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019552896 00000100:00100000:1.0:1788909299.040543:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019552896 00000100:00100000:1.0:1788909299.040582:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788909299.040590:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019552896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788909299.040758:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019552896:12345-0@lo:502:mount.lustre.0 Request processed in 168us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909299.040765:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788909299.040895:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019552896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788909299.040962:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788909299.040972:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788909299.042038:0:15165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788909299.042048:0:15165:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788909299.042054:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909299.042063:0:15165:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788909299.042069:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788909299.042083:0:15165:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89053cc54d28) 00000020:00000080:3.0:1788909299.042104:0:15165:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788909299.042134:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788909299.042213:0:15165:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890537b24800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788909299.042221:0:15165:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788909299.042231:0:15165:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x733cfdd8721d6740 00010000:00010000:3.0:1788909299.045893:0:15165:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788909299.046549:0:15165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788909299.051984:0:15165:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788909299.053351:0:15165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788909299.053363:0:15165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909299.053369:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909299.053371:0:15165:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788909299.053374:0:15165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788909299.053377:0:15165:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788909299.053378:0:15165:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788909299.053380:0:15165:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788909299.053381:0:15165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788909299.053383:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909299.053384:0:15165:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788909299.053386:0:15165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909299.053389:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909299.053390:0:15165:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788909299.053393:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788909299.053394:0:15165:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788909299.053396:0:15165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909299.053398:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909299.053399:0:15165:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788909299.053412:0:15165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788909299.053414:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909299.053416:0:15165:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788909299.053419:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788909299.053477:0:15165:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788909299.053479:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909299.053481:0:15165:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788909299.053484:0:15165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788909299.053686:0:15151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788909299.053723:0:15151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788909299.053752:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6800/0x733cfdd8721d672b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6732 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909299.053763:0:15151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8905180a6800/0x733cfdd8721d672b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6732 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909299.053771:0:15151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff890537b24800 from 1 10000000:01000000:1.0:1788909299.053773:0:15151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788909299.053818:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909299.053826:0:15151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909299.053837:0:15151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909299.053868:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788909299.053954:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909299.054005:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff89051ea46180 going to sleep for 11 seconds 00000100:00100000:3.0:1788909299.058362:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019553024 00000100:00100000:3.0:1788909299.058377:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019553024 00000100:00100000:3.0:1788909299.058441:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788909299.058452:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+14:15151:x1875807019553024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909299.058469:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909299.058491:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d6747 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.058519:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d6747 expref: 15 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.058530:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d6747 expref: 15 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.058540:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6600, rc 0) 00000100:00100000:3.0:1788909299.058623:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553024:12345-0@lo:101:mount.lustre.0 Request processed in 172us (4670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909299.058630:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788909299.058748:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788909299.058766:0:15151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.058775:0:15151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788909299.059345:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788909299.059794:0:15151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788909299.060021:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788909299.060060:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788909299.060133:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788909299.060141:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788909299.060203:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788909299.060248:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909299.060280:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788909299.060659:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019553152 00000100:00100000:0.0:1788909299.060667:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019553152 00000100:00100000:0.0:1788909299.060758:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788909299.060772:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788909299.061010:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553152:12345-0@lo:501:mount.lustre.0 Request processed in 243us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909299.061018:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788909299.061252:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788909299.061289:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788909299.061332:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909299.062431:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909299.062519:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019553280 00000100:00100000:3.0:1788909299.062527:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019553280 00000100:00100000:3.0:1788909299.062564:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788909299.062573:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788909299.062787:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553280:12345-0@lo:503:mount.lustre.0 Request processed in 215us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909299.062806:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788909299.063001:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788909299.063522:0:15151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788909299.063605:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788909299.063650:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909299.063673:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909299.063917:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019553408 00000100:00100000:3.0:1788909299.063923:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019553408 00000100:00100000:3.0:1788909299.063950:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788909299.063958:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788909299.064149:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553408:12345-0@lo:502:mount.lustre.0 Request processed in 191us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909299.064157:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788909299.064248:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788909299.064484:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788909299.064531:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788909299.064578:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788909299.064614:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788909299.064650:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788909299.064733:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788909299.064774:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788909299.064970:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788909299.065009:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788909299.065064:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909299.065105:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531e8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909299.065224:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019553536 00000100:00100000:3.0:1788909299.065231:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019553536 00000100:00100000:3.0:1788909299.065259:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788909299.065267:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788909299.065426:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553536:12345-0@lo:502:mount.lustre.0 Request processed in 158us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909299.065433:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788909299.065521:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788909299.065603:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788909299.065613:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788909299.070037:0:15169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909299.070050:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909299.070052:0:15169:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788909299.070058:0:15169:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff890537b24800 00000020:00000080:0.0:1788909299.070060:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788909299.070067:0:15169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909299.070070:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909299.070071:0:15169:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788909299.070073:0:15169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909299.070075:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909299.070076:0:15169:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788909299.070079:0:15169:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff890537b24800 00000020:00000080:0.0:1788909299.070081:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788909299.070968:0:15169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909299.070975:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909299.070977:0:15169:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788909299.070980:0:15169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909299.070983:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909299.070985:0:15169:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788909299.070989:0:15169:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890537b24800 00000020:00000080:0.0:1788909299.070991:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788909299.071049:0:15169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909299.071053:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909299.071055:0:15169:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788909299.071058:0:15169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788909299.078800:0:15151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788909299.078850:0:15151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788909299.078875:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.078887:0:15151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909299.078937:0:15151:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788909299.078940:0:15151:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890537b24800 10000000:01000000:3.0:1788909299.078944:0:15151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890537b24800 10000000:01000000:3.0:1788909299.078948:0:15151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788909299.078955:0:15151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff890537b24800 from 1 10000000:01000000:3.0:1788909299.078958:0:15151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788909299.078992:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a7e00/0x733cfdd8721d6755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.079006:0:15151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8905180a7e00/0x733cfdd8721d6755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.079018:0:15151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8905180a7e00/0x733cfdd8721d6755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909299.079043:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788909299.079128:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.079172:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019553664 00000100:00100000:3.0:1788909299.079179:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019553664 00000100:00100000:3.0:1788909299.079226:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788909299.079234:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019553664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909299.079247:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909299.079258:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a6400/0x733cfdd8721d675c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d6755 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.079280:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a6400/0x733cfdd8721d675c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d6755 expref: 16 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.079290:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a6400/0x733cfdd8721d675c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d6755 expref: 16 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.079299:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6400, rc 0) 00000100:00100000:3.0:1788909299.079331:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019553664:12345-0@lo:101:mount.lustre.0 Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909299.079338:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788909299.079380:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511848c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909299.079407:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909299.079422:0:15151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8905180a7e00/0x733cfdd8721d6755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d675c expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.079431:0:15151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8905180a7e00/0x733cfdd8721d6755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d675c expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788909299.080025:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788909299.080485:0:15151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788909299.080742:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788909299.080789:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788909299.080826:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788909299.080877:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788909299.080917:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788909299.080968:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788909299.081008:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788909299.081046:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788909299.081096:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788909299.081182:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788909299.081219:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788909299.081277:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788909299.081310:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788909299.081339:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788909299.081390:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788909299.081429:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788909299.081466:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788909299.081511:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788909299.081544:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788909299.091531:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788909299.091672:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788909299.091727:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788909299.091822:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788909299.091892:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788909299.091929:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788909299.091987:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788909299.092036:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788909299.092072:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788909299.092188:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788909299.092196:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788909299.092301:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909299.092362:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.092410:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a58840 going to sleep for 11 seconds 00000100:00100000:3.0:1788909299.094956:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019553792 00000100:00100000:3.0:1788909299.094974:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019553792 00000100:00100000:3.0:1788909299.095037:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788909299.095048:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019553792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909299.095379:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019553792:12345-0@lo:501:mount.lustre.0 Request processed in 332us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909299.095387:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788909299.095447:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909299.096957:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788909299.097028:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909299.097074:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a58840 going to sleep for 11 seconds 00000100:00100000:0.0:1788909299.097545:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019553920 00000100:00100000:0.0:1788909299.097553:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019553920 00000100:00100000:0.0:1788909299.097605:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788909299.097614:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019553920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788909299.098602:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019553920:12345-0@lo:503:mount.lustre.0 Request processed in 984us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909299.098613:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788909299.100044:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019553920:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788909299.104370:0:15151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788909299.104482:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019554048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788909299.104570:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909299.104619:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff89050841c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788909299.106367:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019554048 00000100:00100000:2.0:1788909299.106381:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019554048 00000100:00100000:2.0:1788909299.106436:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788909299.106446:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019554048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788909299.106745:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019554048:12345-0@lo:502:mount.lustre.0 Request processed in 299us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909299.106754:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788909299.106949:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019554048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788909299.107235:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788909299.108486:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788909299.108533:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788909299.108596:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788909299.108637:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788909299.108688:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788909299.108737:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788909299.108888:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788909299.108944:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788909299.108978:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788909299.109010:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788909299.109057:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788909299.109092:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788909299.109163:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788909299.109213:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788909299.109247:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788909299.109278:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788909299.109319:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788909299.109369:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788909299.109404:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788909299.109454:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788909299.109490:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788909299.109525:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788909299.109590:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788909299.109627:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788909299.109661:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788909299.109718:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788909299.109758:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788909299.110526:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788909299.110626:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788909299.110669:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788909299.110716:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788909299.110756:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788909299.111008:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788909299.111050:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788909299.111176:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788909299.111218:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788909299.111250:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788909299.111297:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788909299.111356:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788909299.111420:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019554176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788909299.111506:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909299.111610:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890507c940c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909299.117286:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019554176 00000100:00100000:0.0:1788909299.117301:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019554176 00000100:00100000:0.0:1788909299.117359:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788909299.117369:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019554176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788909299.117658:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019554176:12345-0@lo:502:mount.lustre.0 Request processed in 289us (6151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909299.117665:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788909299.118441:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019554176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788909299.118567:0:15151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788909299.118584:0:15151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788909299.120634:0:15174:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788909299.120652:0:15174:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff890518370000) 00000020:00000080:0.0:1788909299.120675:0:15174:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788909299.120785:0:15174:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890537b24800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788909299.120789:0:15174:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890537b24800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788909299.120792:0:15174:0:(obd_mount.c:710:lustre_put_lsi()) put ffff890537b24800 3 00010000:00080000:0.0:1788909299.120892:0:15174:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8905379d5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788909299.123696:0:15174:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788909299.124034:0:15174:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788909299.124078:0:15174:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788909299.124093:0:15174:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x733cfdd8721d676a 00000100:00080000:1.0:1788909299.124104:0:15174:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788909299.124144:0:15174:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8905379d5000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788909299.124183:0:15174:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8905342a5500 x1875807019554304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788909299.124270:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875807019554304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788909299.124373:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788909299.124439:0:15174:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788909299.124537:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019554304 00000100:00100000:3.0:1788909299.124545:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019554304 00000100:00100000:3.0:1788909299.124585:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788909299.124594:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875807019554304:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788909299.124616:0:14467:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:3.0:1788909299.124647:0:14467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x733cfdd8721d6771 00000004:00100000:3.0:1788909299.124670:0:14467:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788909299.124698:0:14467:0:(import.c:65:import_set_state_nolock()) ffff8905104d2800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788909299.126505:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788909299.126512:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788909299.126515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788909299.126519:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788909299.126592:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019554432:0@lo:400:kworker.0 00000100:00100000:2.0:1788909299.126657:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909299.126737:0:14469:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788909299.126746:0:14469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788909299.130012:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875807019554304:12345-0@lo:38:llog_process_th.0 Request processed in 5405us (5626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909299.130027:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788909299.130055:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019554432 00000100:00100000:3.0:1788909299.130065:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019554432 00000100:00100000:3.0:1788909299.130138:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788909299.130146:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019554432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909299.130216:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019554432:12345-0@lo:400:kworker.0 Request processed in 72us (3560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909299.130222:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788909299.130330:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89052df6ea00 x1875807019554432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909299.130346:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019554432:0@lo:400:kworker.0 00010000:00080000:1.0:1788909299.130532:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8905342a5500 x1875807019554304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788909309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788909299.130543:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788909299.130552:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788909299.130560:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788909299.130565:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788909299.130569:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8905379d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788909299.130576:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875807019554304:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788909299.133248:0:15174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788909299.133451:0:15151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788909299.133476:0:15151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788909299.133489:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a7e00/0x733cfdd8721d6755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d675c expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.133500:0:15151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8905180a7e00/0x733cfdd8721d6755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d675c expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788909299.133546:0:15151:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788909299.133551:0:15151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788909299.133552:0:15151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788909299.133553:0:15151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788909299.133554:0:15151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788909299.133556:0:15151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788909299.133557:0:15151:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788909299.133559:0:15151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788909299.133560:0:15151:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788909299.133564:0:15151:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788909299.133566:0:15151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788909299.133567:0:15151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788909299.133568:0:15151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788909299.133569:0:15151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788909299.133570:0:15151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788909299.133571:0:15151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788909299.133572:0:15151:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788909299.133574:0:15151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788909299.133574:0:15151:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788909299.133599:0:15151:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788909299.133621:0:15151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019554560:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788909299.133694:0:15151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909299.133743:0:15151:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502e17000 going to sleep for 11 seconds 00000100:00100000:2.0:1788909299.133830:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019554560 00000100:00100000:2.0:1788909299.133840:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019554560 00000100:00100000:2.0:1788909299.133898:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788909299.133908:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15151:x1875807019554560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788909299.133936:0:14463:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788909299.133950:0:14463:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788909299.159828:0:14463:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788909299.159847:0:14463:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788909299.160020:0:14483:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788909299.160025:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788909299.160050:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909299.160088:0:14483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d66de expref: 16 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909299.160098:0:14483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909299.160163:0:14483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d66de expref: 16 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909299.160178:0:14483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d66de expref: 16 pid: 14462 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909299.160193:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14483:1875807019554688:0@lo:104: 00000100:00100000:1.0:1788909299.160260:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909299.160309:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788909299.160389:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019554688 00000100:00100000:0.0:1788909299.160397:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019554688 00000100:00100000:0.0:1788909299.160461:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788909299.160471:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:14483:x1875807019554688:12345-0@lo:104: 00010000:00010000:0.0:1788909299.160482:0:14452:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.160539:0:14452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788909299.160545:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:14483:x1875807019554688:12345-0@lo:104: Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909299.160551:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788909299.160689:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14483:1875807019554688:0@lo:104: 00010000:00010000:1.0:1788909299.160718:0:14483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.162582:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909299.162594:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.162604:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768400 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909299.162609:0:14456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.162618:0:14456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909299.162625:0:14456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909299.162631:0:14456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909299.162682:0:14456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.162719:0:14456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909299.162743:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.162750:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89053c768400/0x733cfdd8721d66de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d66e5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909299.162767:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909299.162768:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909299.162770:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909299.162922:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019554816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788909299.162989:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909299.164349:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019554816 00000100:00100000:0.0:1788909299.164376:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019554816 00010000:00010000:0.0:1788909299.164430:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d66de expref: 17 pid: 14462 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909299.164475:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788909299.164485:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:3283:x1875807019554816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788909299.164497:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909299.164504:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d66de expref: 17 pid: 14462 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164517:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d66de expref: 17 pid: 14462 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164534:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d66e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d66de expref: 17 pid: 14462 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164553:0:14455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164560:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788909299.164576:0:14455:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004551605s 00010000:00010000:0.0:1788909299.164581:0:14455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164587:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164595:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164614:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164621:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909299.164625:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164633:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164657:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909299.164668:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788909299.164742:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:3283:x1875807019554816:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909299.164750:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788909299.164954:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019554816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788909299.165022:0:14483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.165030:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909299.165036:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89053c768600/0x733cfdd8721d6778 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909299.173297:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:15151:x1875807019554560:12345-0@lo:253:mount.lustre.0 Request processed in 39381us (39593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909299.173313:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788909299.173460:0:15151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15151:1875807019554560:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788909299.173474:0:15151:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788909299.173478:0:15151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788909299.173479:0:15151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788909299.173480:0:15151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909299.173481:0:15151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909299.173483:0:15151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909299.173484:0:15151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909299.173485:0:15151:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909299.173487:0:15151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909299.173488:0:15151:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788909299.173500:0:15151:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788909299.177738:0:15151:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909299.177918:0:15151:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909299.178084:0:15151:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909299.179009:0:15151:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788909299.179238:0:15151:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788909299.179546:0:15151:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788909299.180384:0:15151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788909299.227986:0:15151:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788909299.227997:0:15151:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788909299.228035:0:15151:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788909299.228086:0:15151:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788909299.228103:0:15151:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788909299.228152:0:15151:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788909299.271280:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788909299.735983:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788909300.294039:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788909300.997262:0:14465:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788909300.997274:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89053c610000 from 7 10000000:01000000:0.0:1788909300.997280:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788909300.997356:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909300.997371:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909300.997397:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909300.997452:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019554944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788909300.997539:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909300.997877:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905205b4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788909301.002080:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019554944 00000100:00100000:3.0:1788909301.002133:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019554944 00000100:00100000:3.0:1788909301.002196:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788909301.002205:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+15:14465:x1875807019554944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909301.002222:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909301.002256:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d677f expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909301.002289:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d677f expref: 16 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909301.002301:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d677f expref: 16 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909301.002312:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7a00, rc 0) 00000100:00100000:3.0:1788909301.002923:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:14465:x1875807019554944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 717us (5382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909301.002931:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788909301.003094:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019554944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788909301.003228:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909301.003240:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909301.003527:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019555072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788909301.003585:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909301.003702:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890503919240 going to sleep for 11 seconds 00000100:00100000:1.0:1788909301.003825:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019555072 00000100:00100000:1.0:1788909301.003833:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019555072 00000100:00100000:1.0:1788909301.003884:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788909301.003894:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:14465:x1875807019555072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788909301.003917:0:14463:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788909301.003946:0:14463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788909301.003949:0:14463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788909301.004305:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:14465:x1875807019555072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 412us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909301.004312:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788909301.004380:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019555072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788909301.004450:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788909301.004458:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909301.004467:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909301.318415:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909302.346392:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909303.369057:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909304.393528:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788909304.453554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788909304.453562:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788909304.453565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788909304.453569:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788909304.453658:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019555200:0@lo:400:kworker.0 00000100:00100000:2.0:1788909304.455018:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909304.455080:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019555456:0@lo:400:kworker.0 00000100:00100000:0.0:1788909304.455152:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909304.455185:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788909304.455193:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019555328:0@lo:400:kworker.0 00000100:00100000:0.0:1788909304.455221:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909304.455270:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019555456 00000100:00100000:0.0:1788909304.455277:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019555456 00000100:00100000:0.0:1788909304.455336:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019555328 00000100:00100000:0.0:1788909304.455339:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019555328 00000100:00100000:0.0:1788909304.455363:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788909304.455374:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019555456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909304.455433:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019555200 00000100:00100000:2.0:1788909304.455439:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019555200 00000100:00100000:2.0:1788909304.455469:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788909304.455476:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:3284:x1875807019555200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909304.455531:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:3284:x1875807019555200:12345-0@lo:400:kworker.0 Request processed in 55us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909304.455547:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019555456:12345-0@lo:400:kworker.0 Request processed in 173us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909304.455554:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788909304.455560:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788909304.455585:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788909304.455593:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019555328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909304.455643:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875807019555328:12345-0@lo:400:kworker.0 Request processed in 52us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909304.455650:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788909304.455695:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89052df6e300 x1875807019555328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909304.455708:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875807019555328:0@lo:400:kworker.0 00000100:00100000:2.0:1788909304.455760:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019555200:0@lo:400:kworker.0 00000100:00080000:3.0:1788909304.456236:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788909304.456499:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89052df6d880 x1875807019555456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788909304.456510:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019555456:0@lo:400:kworker.0 00000001:02000400:2.0:1788909305.247076:0:15519:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788909305.420959:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909306.437606:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909307.461883:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909308.490692:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909309.512257:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788909309.575036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788909309.575043:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788909309.575069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788909309.575076:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788909309.575146:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788909309.575169:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019555840:0@lo:400:kworker.0 00000100:00100000:2.0:1788909309.575267:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909309.575349:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019555840 00000100:00100000:2.0:1788909309.575359:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019555840 00000100:00100000:2.0:1788909309.575423:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788909309.575433:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019555840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909309.575484:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875807019555840:12345-0@lo:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909309.575491:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788909309.575542:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89052df6ed80 x1875807019555840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909309.575554:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875807019555840:0@lo:400:kworker.0 00000100:00100000:3.0:1788909309.575944:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019555712:0@lo:400:kworker.0 00000100:00100000:3.0:1788909309.575981:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909309.576005:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788909309.576011:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019555584:0@lo:400:kworker.0 00000100:00100000:3.0:1788909309.576036:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788909309.576096:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909309.576144:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019555712 00000100:00100000:3.0:1788909309.576167:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019555712 00000100:00100000:3.0:1788909309.576193:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788909309.576200:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019555712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909309.576235:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019555712:12345-0@lo:400:kworker.0 Request processed in 35us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909309.576241:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788909309.576600:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89052df6c000 x1875807019555712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909309.576613:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019555712:0@lo:400:kworker.0 00000100:00100000:1.0:1788909309.578684:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019555584 00000100:00100000:1.0:1788909309.578701:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019555584 00000100:00100000:1.0:1788909309.578763:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788909309.578773:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:3284:x1875807019555584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909309.578858:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:3284:x1875807019555584:12345-0@lo:400:kworker.0 Request processed in 86us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909309.578865:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788909309.579265:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019555584:0@lo:400:kworker.0 00000040:00080000:1.0:1788909309.959639:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788909310.533446:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909311.565031:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788909311.635868:0:15867:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788909311.635872:0:15867:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788909311.636007:0:15867:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8905379d4000 00000020:01000004:0.0:1788909311.636023:0:15867:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788909311.636036:0:15867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788909311.636059:0:15867:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8905344e0000) 00000020:00000080:0.0:1788909311.636094:0:15867:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788909311.657913:0:15867:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788909311.658387:0:15867:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788909311.659061:0:15867:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788909311.659564:0:15867:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788909311.659775:0:15867:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788909311.660396:0:15867:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 433: rc = 0 00100000:10000000:0.0:1788909311.660558:0:15867:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 433: rc = 0 00100000:10000000:0.0:1788909311.660651:0:15867:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 433: rc = 0 00100000:10000000:0.0:1788909311.661065:0:15867:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 233: rc = 0 00100000:10000000:0.0:1788909311.661693:0:15867:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 233: rc = 0 00100000:10000000:0.0:1788909311.662408:0:15867:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 233: rc = 0 00100000:10000000:0.0:1788909311.662678:0:15867:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 233: rc = 0 00100000:10000000:0.0:1788909311.662922:0:15867:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 233: rc = 0 00100000:10000000:0.0:1788909311.663492:0:15867:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 233: rc = 0 00000020:00000080:0.0:1788909311.664421:0:15867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788909311.664440:0:15867:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788909311.664455:0:15867:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x733cfdd8721d6794 00000020:01000004:0.0:1788909311.664475:0:15867:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788909311.664499:0:15867:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788909311.664503:0:15867:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788909311.664509:0:15867:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788909311.664539:0:15867:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788909311.664544:0:15867:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788909311.673979:0:15867:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788909311.674019:0:15867:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788909311.674023:0:15867:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788909311.674025:0:15867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788909311.674027:0:15867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788909311.674028:0:15867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788909311.674030:0:15867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788909311.674031:0:15867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788909311.674033:0:15867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788909311.674034:0:15867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788909311.674036:0:15867:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788909311.674040:0:15867:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788909311.674042:0:15867:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788909311.674043:0:15867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788909311.674045:0:15867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788909311.674046:0:15867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788909311.674047:0:15867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788909311.674048:0:15867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788909311.674049:0:15867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788909311.674054:0:15867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788909311.674055:0:15867:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788909311.674365:0:15867:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788909311.674393:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019555968:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788909311.674518:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909311.674649:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905274af000 going to sleep for 11 seconds 00000100:00100000:2.0:1788909311.674713:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019555968 00000100:00100000:2.0:1788909311.674722:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019555968 00000100:00100000:2.0:1788909311.674813:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788909311.674830:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15867:x1875807019555968:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788909311.674861:0:14460:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788909311.674864:0:14460:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788909311.674869:0:14460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788909311.685026:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15867:x1875807019555968:12345-0@lo:253:mount.lustre.0 Request processed in 10189us (10499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909311.685042:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788909311.685551:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019555968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788909311.685571:0:15867:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788909311.685575:0:15867:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788909311.685578:0:15867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788909311.685579:0:15867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788909311.685581:0:15867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788909311.685582:0:15867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788909311.685584:0:15867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788909311.685586:0:15867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788909311.685588:0:15867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788909311.685589:0:15867:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788909311.685643:0:15867:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8905379d4000 from lustre-OST0001 10000000:01000000:0.0:1788909311.685702:0:15867:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788909311.685706:0:15867:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788909311.685716:0:15867:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89052e904d28 local copy 00010000:00010000:0.0:1788909311.685727:0:15867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909311.685971:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788909311.686016:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909311.686273:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a46c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788909311.686651:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019556096 00000100:00100000:2.0:1788909311.686661:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019556096 00000100:00100000:2.0:1788909311.686763:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788909311.686773:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15867:x1875807019556096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788909311.687004:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15867:x1875807019556096:12345-0@lo:501:mount.lustre.0 Request processed in 232us (987us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788909311.687012:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788909311.687143:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556096:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788909311.687178:0:15867:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788909311.687368:0:15867:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788909311.687378:0:15867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909311.687389:0:15867:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89052dc10200/0x733cfdd8721d6605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d660c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909311.687422:0:15867:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8905379d4000 10000000:01000000:3.0:1788909311.687428:0:15867:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788909311.687435:0:15867:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788909311.687437:0:15867:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788909311.687443:0:15867:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788909311.687447:0:15867:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788909311.687494:0:15867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a7c00/0x733cfdd8721d679b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909311.687514:0:15867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8905180a7c00/0x733cfdd8721d679b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909311.687526:0:15867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8905180a7c00/0x733cfdd8721d679b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909311.687548:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788909311.687586:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909311.688070:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905062040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909311.688360:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019556224 00000100:00100000:0.0:1788909311.688368:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019556224 00000100:00100000:0.0:1788909311.688412:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788909311.688423:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:15867:x1875807019556224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788909311.688438:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909311.688676:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89053c517200/0x733cfdd8721d67a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d679b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909311.688714:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89053c517200/0x733cfdd8721d67a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d679b expref: 17 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909311.688726:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89053c517200/0x733cfdd8721d67a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d679b expref: 17 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909311.688736:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517200, rc 0) 00000100:00100000:0.0:1788909311.688790:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556224:12345-0@lo:101:mount.lustre.0 Request processed in 368us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909311.688797:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788909311.688886:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788909311.688900:0:15867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8905180a7c00/0x733cfdd8721d679b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d67a2 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909311.688909:0:15867:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8905180a7c00/0x733cfdd8721d679b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d67a2 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788909311.689881:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788909311.690965:0:15867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788909311.691575:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788909311.691626:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788909311.691660:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788909311.691705:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788909311.691740:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788909311.691769:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788909311.691833:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788909311.691840:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788909311.691945:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909311.692015:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909311.692086:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506204b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788909311.692188:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019556352 00000100:00100000:2.0:1788909311.692199:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019556352 00000100:00100000:3.0:1788909311.692513:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788909311.692523:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909311.692998:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556352:12345-0@lo:501:mount.lustre.0 Request processed in 475us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.693006:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788909311.693407:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788909311.693484:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556480:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788909311.693537:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909311.693578:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909311.693644:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019556480 00000100:00100000:3.0:1788909311.693650:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019556480 00000100:00100000:3.0:1788909311.693685:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788909311.693693:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788909311.694016:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556480:12345-0@lo:503:mount.lustre.0 Request processed in 323us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.694024:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788909311.694419:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556480:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788909311.698045:0:15867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788909311.698818:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556608:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788909311.698917:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909311.699033:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909311.701825:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019556608 00000100:00100000:3.0:1788909311.701845:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019556608 00000100:00100000:3.0:1788909311.701964:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788909311.701976:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788909311.702708:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556608:12345-0@lo:502:mount.lustre.0 Request processed in 730us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.702719:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788909311.702979:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788909311.703625:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788909311.703683:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788909311.703710:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788909311.703753:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788909311.703783:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788909311.703808:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788909311.703843:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788909311.703870:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788909311.703914:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788909311.703972:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788909311.704056:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909311.704360:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788909311.704478:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019556736 00000100:00100000:1.0:1788909311.704489:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019556736 00000100:00100000:1.0:1788909311.704559:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788909311.704571:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788909311.704798:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556736:12345-0@lo:502:mount.lustre.0 Request processed in 230us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909311.704806:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788909311.705015:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788909311.705410:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788909311.705425:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788909311.710745:0:15869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788909311.710775:0:15869:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788909311.710784:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788909311.710787:0:15869:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788909311.710796:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788909311.710813:0:15869:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89053cc53370) 00000020:00000080:3.0:1788909311.710842:0:15869:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788909311.710848:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788909311.712419:0:15869:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8905379d4000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788909311.712431:0:15869:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788909311.712441:0:15869:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x733cfdd8721d67b0 00010000:00010000:2.0:1788909311.726445:0:15869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788909311.726965:0:15869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788909311.728411:0:15869:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788909311.730735:0:15869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788909311.730747:0:15869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909311.730754:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909311.730756:0:15869:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788909311.730760:0:15869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788909311.730764:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909311.730765:0:15869:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788909311.730768:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788909311.730770:0:15869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788909311.730772:0:15869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909311.730774:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909311.730776:0:15869:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788909311.730788:0:15869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788909311.730790:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909311.730792:0:15869:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788909311.730795:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788909311.730848:0:15869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788909311.730851:0:15869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788909311.730852:0:15869:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788909311.730855:0:15869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788909311.733522:0:15867:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788909311.733566:0:15867:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788909311.733594:0:15867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a7c00/0x733cfdd8721d679b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d67a2 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909311.733606:0:15867:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8905180a7c00/0x733cfdd8721d679b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d67a2 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788909311.733626:0:15867:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905379d4000 from 1 10000000:01000000:0.0:1788909311.733629:0:15867:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788909311.733669:0:15867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909311.733678:0:15867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909311.733688:0:15867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909311.733722:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788909311.733795:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909311.733846:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788909311.735482:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019556864 00000100:00100000:1.0:1788909311.735497:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019556864 00000100:00100000:1.0:1788909311.735612:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788909311.735636:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:15867:x1875807019556864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788909311.735660:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909311.735682:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d67b7 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.735718:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d67b7 expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.735731:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d67b7 expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.735741:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769800, rc 0) 00000100:00100000:1.0:1788909311.735837:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019556864:12345-0@lo:101:mount.lustre.0 Request processed in 201us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909311.735844:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788909311.735940:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788909311.735961:0:15867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909311.735971:0:15867:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788909311.736618:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788909311.737070:0:15867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788909311.737372:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788909311.737416:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788909311.737494:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788909311.737502:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788909311.737574:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788909311.737641:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909311.751319:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788909311.754178:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019556992 00000100:00100000:3.0:1788909311.754196:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019556992 00000100:00100000:3.0:1788909311.754269:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788909311.754280:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019556992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909311.754639:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019556992:12345-0@lo:501:mount.lustre.0 Request processed in 359us (16996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.754648:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788909311.754889:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019556992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788909311.754954:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788909311.755008:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909311.755050:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788909311.756255:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019557120 00000100:00100000:3.0:1788909311.756269:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019557120 00000100:00100000:3.0:1788909311.756342:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788909311.756354:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019557120:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788909311.756794:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019557120:12345-0@lo:503:mount.lustre.0 Request processed in 441us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.756803:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788909311.757164:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557120:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788909311.757891:0:15867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788909311.757973:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557248:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788909311.758026:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909311.758052:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909311.760515:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019557248 00000100:00100000:3.0:1788909311.760534:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019557248 00000100:00100000:3.0:1788909311.760605:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788909311.760616:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019557248:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788909311.760935:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019557248:12345-0@lo:502:mount.lustre.0 Request processed in 321us (2908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.760944:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788909311.761340:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557248:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788909311.761643:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788909311.761699:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788909311.761746:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788909311.761778:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788909311.761807:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788909311.761850:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788909311.761881:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788909311.761924:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788909311.761958:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788909311.762010:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909311.762168:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537ed1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788909311.766265:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019557376 00000100:00100000:1.0:1788909311.766284:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019557376 00000100:00100000:1.0:1788909311.766369:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788909311.766380:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019557376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788909311.766718:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019557376:12345-0@lo:502:mount.lustre.0 Request processed in 339us (4706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909311.766727:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788909311.767028:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788909311.767218:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788909311.767235:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788909311.769437:0:15873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909311.769453:0:15873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909311.769455:0:15873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788909311.769461:0:15873:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8905379d4000 00000020:00000080:0.0:1788909311.769475:0:15873:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788909311.769483:0:15873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909311.769486:0:15873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909311.769487:0:15873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788909311.769490:0:15873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909311.769492:0:15873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909311.769494:0:15873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788909311.769497:0:15873:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8905379d4000 00000020:00000080:0.0:1788909311.769512:0:15873:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788909311.769616:0:15873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909311.769621:0:15873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909311.769622:0:15873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788909311.769625:0:15873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788909311.769628:0:15873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909311.769629:0:15873:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788909311.769633:0:15873:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8905379d4000 00000020:00000080:0.0:1788909311.769635:0:15873:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788909311.777741:0:15873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788909311.777753:0:15873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788909311.777755:0:15873:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788909311.777759:0:15873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788909311.777913:0:15867:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788909311.777940:0:15867:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788909311.777966:0:15867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.777977:0:15867:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909311.778030:0:15867:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788909311.778033:0:15867:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8905379d4000 10000000:01000000:1.0:1788909311.778035:0:15867:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8905379d4000 10000000:01000000:1.0:1788909311.778039:0:15867:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788909311.778044:0:15867:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8905379d4000 from 1 10000000:01000000:1.0:1788909311.778047:0:15867:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788909311.778081:0:15867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c769e00/0x733cfdd8721d67c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.778091:0:15867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c769e00/0x733cfdd8721d67c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.778103:0:15867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c769e00/0x733cfdd8721d67c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909311.778150:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788909311.778220:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909311.778257:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909311.778615:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019557504 00000100:00100000:2.0:1788909311.778990:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019557504 00000100:00100000:2.0:1788909311.779036:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788909311.779044:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019557504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788909311.779058:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909311.781346:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d67cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d67c5 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.781395:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d67cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d67c5 expref: 19 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.781409:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89052dc11e00/0x733cfdd8721d67cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d67c5 expref: 19 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.781419:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89052dc11e00, rc 0) 00000100:00100000:2.0:1788909311.781528:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019557504:12345-0@lo:101:mount.lustre.0 Request processed in 2483us (3306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909311.781537:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788909311.781916:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788909311.781936:0:15867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c769e00/0x733cfdd8721d67c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d67cc expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.781946:0:15867:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c769e00/0x733cfdd8721d67c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d67cc expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788909311.782659:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788909311.783062:0:15867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788909311.783352:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788909311.783403:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788909311.783435:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788909311.783493:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788909311.783530:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788909311.783575:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788909311.783606:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788909311.783635:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788909311.783680:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788909311.783712:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788909311.783741:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788909311.783784:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788909311.783818:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788909311.783851:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788909311.783893:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788909311.783924:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788909311.783957:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788909311.784028:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788909311.784061:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788909311.784091:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788909311.784158:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788909311.784192:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788909311.784220:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788909311.784263:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788909311.784310:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788909311.784341:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788909311.784381:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788909311.784412:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788909311.784439:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788909311.784493:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788909311.784530:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788909311.784563:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788909311.784596:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788909311.784665:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788909311.790545:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788909311.790719:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788909311.790760:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788909311.790868:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788909311.790876:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788909311.790983:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788909311.791055:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909311.791106:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909311.791149:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019557632 00000100:00100000:3.0:1788909311.791166:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019557632 00000100:00100000:3.0:1788909311.791215:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788909311.791225:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019557632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788909311.791529:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019557632:12345-0@lo:501:mount.lustre.0 Request processed in 305us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.791538:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788909311.794426:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788909311.794500:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788909311.794574:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909311.794622:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909311.794653:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019557760 00000100:00100000:3.0:1788909311.794660:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019557760 00000100:00100000:3.0:1788909311.794719:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788909311.794728:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019557760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788909311.795035:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019557760:12345-0@lo:503:mount.lustre.0 Request processed in 308us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.795043:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788909311.799430:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557760:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788909311.800090:0:15867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788909311.800234:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788909311.800347:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909311.800405:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909311.800720:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019557888 00000100:00100000:3.0:1788909311.800730:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019557888 00000100:00100000:3.0:1788909311.802797:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788909311.802816:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019557888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788909311.803449:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019557888:12345-0@lo:502:mount.lustre.0 Request processed in 639us (3099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.803459:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788909311.803937:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019557888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788909311.804776:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788909311.804841:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788909311.804880:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788909311.804933:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788909311.804972:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788909311.805388:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788909311.805432:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788909311.805489:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788909311.805559:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788909311.805600:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788909311.805721:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788909311.805780:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788909311.805817:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788909311.805851:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788909311.805902:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788909311.805938:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788909311.805970:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788909311.807857:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788909311.807911:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788909311.807948:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788909311.808399:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788909311.808442:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788909311.808485:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788909311.808534:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788909311.808587:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788909311.808617:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788909311.809796:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788909311.809844:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788909311.809880:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788909311.809935:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788909311.811233:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788909311.811421:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788909311.811458:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788909311.811552:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788909311.811587:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788909311.812066:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788909311.812375:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788909311.812693:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788909311.812757:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788909311.812794:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788909311.812844:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019558016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788909311.812945:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909311.813340:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905379790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909311.813813:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019558016 00000100:00100000:3.0:1788909311.813822:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019558016 00000100:00100000:3.0:1788909311.813879:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788909311.813890:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019558016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788909311.814572:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019558016:12345-0@lo:502:mount.lustre.0 Request processed in 682us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.814581:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788909311.814727:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019558016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788909311.814826:0:15867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788909311.814839:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788909311.817145:0:15878:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788909311.817162:0:15878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89053c6799b8) 00000020:00000080:1.0:1788909311.817185:0:15878:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788909311.817381:0:15878:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8905379d4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788909311.817386:0:15878:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8905379d4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788909311.817389:0:15878:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8905379d4000 3 00010000:00080000:1.0:1788909311.817419:0:15878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8904035cd000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788909311.821872:0:15878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788909311.822076:0:15878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788909311.822138:0:15878:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788909311.822150:0:15878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x733cfdd8721d67da 00000100:00080000:1.0:1788909311.822160:0:15878:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788909311.822166:0:15878:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8904035cd000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788909311.822201:0:15878:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8905342a7480 x1875807019558144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788909311.822237:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875807019558144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788909311.822322:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788909311.822377:0:15878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788909311.822614:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788909311.822625:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788909311.822640:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788909311.822643:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788909311.822712:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909311.822722:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019558272:0@lo:400:kworker.0 00000100:00100000:3.0:1788909311.822754:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909311.822789:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019558400:0@lo:400:kworker.0 00000100:00100000:3.0:1788909311.822815:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909311.822851:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019558144 00000100:00100000:3.0:1788909311.822859:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019558144 00000100:00100000:3.0:1788909311.822885:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019558272 00000100:00100000:3.0:1788909311.822887:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019558272 00000100:00100000:3.0:1788909311.822907:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019558400 00000100:00100000:3.0:1788909311.822909:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019558400 00000100:00100000:3.0:1788909311.822932:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788909311.822940:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019558272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909311.824415:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019558272:12345-0@lo:400:kworker.0 Request processed in 1466us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.824426:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788909311.824457:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788909311.824481:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019558400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909311.824528:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019558400:12345-0@lo:400:kworker.0 Request processed in 64us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.824533:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788909311.824547:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909311.824551:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1875807019558144:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788909311.824572:0:14468:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:3.0:1788909311.824615:0:14468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x733cfdd8721d67e1 00000004:00100000:3.0:1788909311.824645:0:14468:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788909311.824682:0:14468:0:(import.c:65:import_set_state_nolock()) ffff8905180b7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788909311.824725:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875807019558144:12345-0@lo:38:llog_process_th.0 Request processed in 173us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.824732:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788909311.824758:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788909311.824799:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905342a7480 x1875807019558144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788909321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909311.824811:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788909311.824820:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788909311.824827:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788909311.824831:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788909311.824833:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8904035cd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788909311.824839:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875807019558144:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788909311.824873:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905344d9500 x1875807019558400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909311.824884:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019558400:0@lo:400:kworker.0 00010000:00080000:3.0:1788909311.824910:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8905344db800 x1875807019558272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909311.824919:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019558272:0@lo:400:kworker.0 00000040:00080000:1.0:1788909311.825242:0:15878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788909311.827264:0:15867:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788909311.827309:0:15867:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788909311.827335:0:15867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c769e00/0x733cfdd8721d67c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d67cc expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.827348:0:15867:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c769e00/0x733cfdd8721d67c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d67cc expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788909311.827401:0:15867:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788909311.827404:0:15867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788909311.827406:0:15867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909311.827408:0:15867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909311.827409:0:15867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909311.827411:0:15867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909311.827412:0:15867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909311.827415:0:15867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909311.827416:0:15867:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788909311.827421:0:15867:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788909311.827423:0:15867:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788909311.827425:0:15867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788909311.827426:0:15867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909311.827427:0:15867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909311.827428:0:15867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909311.827429:0:15867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909311.827430:0:15867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909311.827431:0:15867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909311.827432:0:15867:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788909311.827460:0:15867:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788909311.827494:0:15867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019558528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788909311.827579:0:15867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909311.827647:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019558528 00000100:00100000:2.0:1788909311.827655:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019558528 00000100:00100000:2.0:1788909311.827700:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788909311.827709:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890537ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:15867:x1875807019558528:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788909311.827740:0:14460:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788909311.827763:0:14460:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788909311.828736:0:15867:0:(client.c:2715:ptlrpc_set_wait()) set ffff890531d82180 going to sleep for 11 seconds 20000000:01000000:3.0:1788909311.873649:0:14460:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788909311.873705:0:14460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788909311.874840:0:14483:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788909311.874850:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788909311.874880:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.874901:0:14483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d677f expref: 19 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.874933:0:14483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.874978:0:14483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d677f expref: 19 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909311.874992:0:14483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d677f expref: 19 pid: 14462 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909311.875007:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14483:1875807019558656:0@lo:104: 00000100:00100000:1.0:1788909311.875086:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909311.875172:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537979f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788909311.875342:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019558656 00000100:00100000:2.0:1788909311.875351:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019558656 00000100:00100000:2.0:1788909311.875404:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788909311.875413:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:14483:x1875807019558656:12345-0@lo:104: 00010000:00010000:2.0:1788909311.875425:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.875504:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788909311.875510:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:14483:x1875807019558656:12345-0@lo:104: Request processed in 99us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909311.875518:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788909311.875626:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14483:1875807019558656:0@lo:104: 00010000:00010000:1.0:1788909311.875645:0:14483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.875754:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909311.875760:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.875769:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517e00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909311.875773:0:14456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.875781:0:14456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909311.875789:0:14456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909311.875794:0:14456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788909311.875855:0:14456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.875876:0:14456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909311.875905:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.875912:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89053c517e00/0x733cfdd8721d677f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d6786 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.875932:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909311.875934:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909311.875935:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909311.875978:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019558784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909311.876008:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909311.876084:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019558784 00000100:00100000:2.0:1788909311.876089:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019558784 00010000:00010000:2.0:1788909311.876127:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d677f expref: 20 pid: 14462 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909311.876218:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788909311.876227:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+20:3284:x1875807019558784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909311.876239:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909311.876244:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d677f expref: 20 pid: 14462 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876255:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d677f expref: 20 pid: 14462 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876268:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8905180a7a00/0x733cfdd8721d6786 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d677f expref: 20 pid: 14462 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876281:0:14455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876300:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788909311.876313:0:14455:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004551605s 00010000:00010000:2.0:1788909311.876317:0:14455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876324:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876331:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876337:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876343:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769a00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909311.876347:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876354:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876368:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876377:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909311.876406:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3284:x1875807019558784:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909311.876413:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788909311.876446:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019558784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909311.876478:0:14483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876486:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909311.876493:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89053c769a00/0x733cfdd8721d67e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909311.883728:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890537ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:15867:x1875807019558528:12345-0@lo:253:mount.lustre.0 Request processed in 56005us (56134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909311.883767:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788909311.883871:0:15867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af89eede-3fcd-45ad-88b4-973cc21df0c9:15867:1875807019558528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788909311.883888:0:15867:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788909311.883891:0:15867:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788909311.883893:0:15867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788909311.883894:0:15867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788909311.883896:0:15867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788909311.883897:0:15867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788909311.883898:0:15867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788909311.883900:0:15867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788909311.883902:0:15867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788909311.883903:0:15867:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788909311.883920:0:15867:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788909311.887845:0:15867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788909311.887999:0:15867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788909311.888386:0:15867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788909311.888545:0:15867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788909311.888694:0:15867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788909311.888894:0:15867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788909311.889764:0:15867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788909311.944599:0:15867:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788909311.944609:0:15867:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788909311.944646:0:15867:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788909311.944698:0:15867:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788909311.944713:0:15867:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788909311.944744:0:15867:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788909312.594805:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909312.837247:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788909297/real 1788909297] req@ffff8905342a4000 x1875807019551616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788909312 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909312.837295:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8905342a4000 x1875807019551616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788909312 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909312.837307:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788909297/real 1788909297] req@ffff8905342a6300 x1875807019551744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788909312 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909312.837320:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8905342a6300 x1875807019551744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788909312 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788909312.837346:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89052747d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788909312.837376:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788909312.837380:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019551616:0@lo:8:kworker.0 00000100:00080000:3.0:1788909312.837387:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8905344ac000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788909312.837403:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788909312.837406:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019551744:0@lo:8:kworker.0 00000100:00080000:2.0:1788909312.837629:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788909312.837634:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788909312.837638:0:37:0:(import.c:65:import_set_state_nolock()) ffff89052747d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788909312.837644:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 379 00000100:00080000:2.0:1788909312.837651:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788909312.837659:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89052747d000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788909312.837686:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89052df6ce00 x1875807019559040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788909312.837718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788909312.837721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788909312.837723:0:37:0:(import.c:65:import_set_state_nolock()) ffff8905344ac000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788909312.837727:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 379 00000100:00080000:2.0:1788909312.837729:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788909312.837734:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8905344ac000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788909312.837760:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89052df6e680 x1875807019559168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788909312.837834:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019559424:0@lo:400:kworker.0 00000100:00100000:2.0:1788909312.837926:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909312.838017:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788909312.838024:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019559552:0@lo:400:kworker.0 00000100:00100000:2.0:1788909312.838070:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909312.838397:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019558912:0@lo:400:kworker.0 00000100:00100000:3.0:1788909312.838456:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909312.838488:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909312.838495:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019559296:0@lo:400:kworker.0 00000100:00100000:3.0:1788909312.838521:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909312.838552:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019558912 00000100:00100000:3.0:1788909312.838562:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019558912 00000100:00100000:3.0:1788909312.838618:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788909312.838630:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:3285:x1875807019558912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909312.838689:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:3285:x1875807019558912:12345-0@lo:400:kworker.0 Request processed in 61us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909312.838697:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788909312.838742:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019559424 00000100:00100000:3.0:1788909312.838746:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019559424 00000100:00100000:3.0:1788909312.838775:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019559552 00000100:00100000:3.0:1788909312.838778:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019559552 00000100:00100000:3.0:1788909312.838801:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019559296 00000100:00100000:3.0:1788909312.838804:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019559296 00000100:00100000:3.0:1788909312.838817:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788909312.838823:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019559424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909312.838860:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019559424:12345-0@lo:400:kworker.0 Request processed in 38us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909312.838866:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788909312.838879:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788909312.838885:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019559552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909312.838927:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019559552:12345-0@lo:400:kworker.0 Request processed in 42us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909312.838934:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788909312.838947:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788909312.838952:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019559296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909312.838991:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019559296:12345-0@lo:400:kworker.0 Request processed in 38us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909312.838996:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788909312.839016:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788909312.839048:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052df6f100 x1875807019559296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788909312.839428:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052df6df80 x1875807019559552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909312.839456:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019559552:0@lo:400:kworker.0 00010000:00080000:2.0:1788909312.839470:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052df6c380 x1875807019559424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909312.839478:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019559424:0@lo:400:kworker.0 00000100:00100000:2.0:1788909312.839515:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019559040:0@lo:8:kworker.0 00000100:00100000:2.0:1788909312.839560:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909312.839595:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019559168:0@lo:8:kworker.0 00000100:00100000:2.0:1788909312.839634:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909312.839672:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019559040 00000100:00100000:2.0:1788909312.839676:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019559040 00000100:00100000:2.0:1788909312.839695:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019559168 00000100:00100000:2.0:1788909312.839697:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019559168 00000100:00100000:2.0:1788909312.839707:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909312.839713:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875807019559040:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788909312.839756:0:15153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:2.0:1788909312.839800:0:15153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d67ef 00002000:00100000:2.0:1788909312.839819:0:15153:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8905375bc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113956 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788909312.839825:0:15153:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788909312.839829:0:15153:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788909312.840502:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019559296:0@lo:400:kworker.0 00000100:00100000:3.0:1788909312.840537:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019558912:0@lo:400:kworker.0 00002000:00080000:2.0:1788909312.843987:0:15153:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788909312.844045:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8905375be000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788909312.844548:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875807019559040:12345-0@lo:8:kworker.0 Request processed in 4828us (4981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909312.844561:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788909312.844610:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788909312.844619:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875807019559168:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788909312.844658:0:15153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:2.0:1788909312.844703:0:15153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x733cfdd8721d67f6 00002000:00100000:2.0:1788909312.844728:0:15153:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8905375bd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113956 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788909312.844733:0:15153:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788909312.844752:0:15153:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788909312.847203:0:15153:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788909312.847270:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8905375bb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788909312.847427:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875807019559168:12345-0@lo:8:kworker.0 Request processed in 2805us (7789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909312.847451:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788909312.850268:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052df6ce00 x1875807019559040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788909332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909312.850289:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788909312.850303:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788909312.850316:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788909312.850324:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788909312.850328:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89052747d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788909312.850355:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788909312.850363:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019559040:0@lo:8:kworker.0 00010000:00080000:2.0:1788909312.850381:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052df6e680 x1875807019559168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788909332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788909312.850389:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788909312.850394:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788909312.850399:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788909312.850403:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788909312.850405:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8905344ac000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788909312.850419:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788909312.850424:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875807019559168:0@lo:8:kworker.0 00000004:00080000:2.0:1788909312.850530:0:14492:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788909312.850557:0:14492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14492:1875807019559808:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788909312.850636:0:14492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909312.850672:0:14492:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788909312.850687:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788909312.850710:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019559680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909312.850740:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909312.850783:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019559808 00000100:00100000:2.0:1788909312.850791:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019559808 00000100:00100000:2.0:1788909312.850857:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788909312.850868:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14492:x1875807019559808:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788909312.853426:0:14489:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788909312.854264:0:14491:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788909312.854604:0:14491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394928493801ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788909312.854675:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019559680 00000100:00100000:1.0:1788909312.854690:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019559680 00000100:00100000:1.0:1788909312.854756:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788909312.854768:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875807019559680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788909312.854800:0:15156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788909312.854908:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875807019559680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909312.854924:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1788909312.855335:0:14489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394929223559ns, next at 0ns, rc = 0 00000100:00080000:0.0:1788909312.855805:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788909312.855883:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89052df6e680 x1875807019559680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788909312.856342:0:14490:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788909312.856379:0:14490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14490:1875807019560064:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788909312.856486:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909312.856530:0:14490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905285fb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909312.856694:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909312.856711:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019559936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909312.856746:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909312.856788:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019559936 00000100:00100000:3.0:1788909312.856795:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019559936 00000100:00100000:3.0:1788909312.856855:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788909312.856865:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875807019559936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909312.856906:0:15156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909312.857228:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875807019559936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 364us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909312.857238:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788909312.857270:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788909312.857296:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905344d9500 x1875807019559936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788909328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909312.857314:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019559936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788909312.859680:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019559680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909312.861401:0:15153:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788909312.861417:0:15153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1788909312.863917:0:15154:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788909312.863934:0:15154:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788909312.863941:0:15154:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:3.0:1788909312.866628:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019560064 00000100:00100000:3.0:1788909312.866649:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019560064 00000100:00100000:3.0:1788909312.866831:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909312.866842:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14490:x1875807019560064:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788909312.871929:0:15931:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788909312.871944:0:15931:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788909312.872272:0:15931:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788909312.887775:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.887795:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.887815:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.887820:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.887827:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.887850:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.887863:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.887872:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.888258:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909312.888286:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909312.888295:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.888307:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.888313:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.888322:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.888346:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.888355:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2627df9/0x733cfdd8721d67fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.888381:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.888383:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.888385:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.889324:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.889335:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.889350:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.889362:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.889371:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.889386:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.889396:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.889404:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.889431:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788909312.889642:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909312.889659:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.889675:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.889681:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.889697:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.889729:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.889737:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ea4df3/0x733cfdd8721d6804 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.889764:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.889766:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.889768:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.889985:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.889993:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.890003:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.890006:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.890010:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.890020:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.890028:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.890045:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.890069:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909312.890090:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909312.890096:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.890104:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10e00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.890139:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.890148:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.892670:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.892697:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f150676/0x733cfdd8721d680b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.892740:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.892743:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.892746:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.893957:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.893981:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894000:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.894005:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.894016:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894036:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894050:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894058:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894103:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788909312.894745:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.894751:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894762:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.894765:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.894769:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894780:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894795:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894804:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894820:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788909312.894835:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788909312.894843:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894851:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11400 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.894856:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894865:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894879:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894886:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043689317/0x733cfdd8721d6812 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894905:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909312.894914:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894921:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc10000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.894924:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894932:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894941:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894948:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009187a652/0x733cfdd8721d6819 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.894959:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.894961:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.894962:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.895247:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.895657:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.895666:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895676:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.895679:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.895684:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895711:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895722:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895730:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895749:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909312.895760:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909312.895765:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895772:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11a00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.895775:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895784:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895799:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895806:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000269611ee/0x733cfdd8721d6820 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.895832:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.895834:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.895836:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.896784:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.896793:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.896808:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.896812:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.896817:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.896828:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.896837:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.896844:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.896869:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788909312.896888:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909312.896901:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.896916:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89052dc11600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.896932:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.896945:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909312.897559:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.897567:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.897590:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.897593:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.897598:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.897608:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.897617:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.897624:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.897640:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909312.897652:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788909312.898045:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.898051:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898059:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.898062:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.898067:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898076:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898093:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898100:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898161:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788909312.898253:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.898263:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000340a257d/0x733cfdd8721d6827 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.898306:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909312.898312:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.898321:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.898326:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.898337:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.898350:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.898358:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fdfed21/0x733cfdd8721d6835 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.898388:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.898390:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.898393:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.898873:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.898885:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898898:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.898901:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.898907:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898919:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898929:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898938:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.898975:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788909312.899812:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.899819:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.899829:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.899833:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.899838:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.899849:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.899856:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.899863:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.899875:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788909312.900636:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.900645:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.900656:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.900666:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.900671:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.900682:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.900690:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.900697:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.900707:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788909312.900845:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788909312.900860:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.900872:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9de00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.900878:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.900888:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.900915:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.900923:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d62d2ee8/0x733cfdd8721d683c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.900970:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788909312.900976:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.900984:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.901002:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901012:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901026:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901033:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1080283/0x733cfdd8721d6843 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901232:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909312.901238:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901247:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.901251:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901260:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901275:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901285:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2586775/0x733cfdd8721d684a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901320:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.901323:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.901328:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.901462:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.901470:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.901483:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.901486:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.901490:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.901500:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.901577:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.901594:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.901631:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788909312.901649:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909312.901656:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901665:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.901669:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901678:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901693:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901701:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d53d677/0x733cfdd8721d6851 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.901721:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.901723:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.901726:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.902183:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.902190:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.902200:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.902204:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.902208:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.902216:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.902223:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.902230:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.902250:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788909312.902878:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909312.902890:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.902902:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9dc00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909312.902907:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.902918:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909312.904627:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.904640:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.904667:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.904671:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.904678:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.904693:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.904703:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.904711:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.904723:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788909312.905206:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905225:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bac73f6/0x733cfdd8721d6858 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909312.905239:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.905248:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.905259:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.905262:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.905267:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.905278:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.905301:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.905310:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.905325:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788909312.905537:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788909312.905546:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905557:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909312.905563:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905574:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905590:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905597:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101b6125/0x733cfdd8721d685f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905613:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909312.905617:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905634:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909312.905637:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905646:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905657:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905664:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cfefe33/0x733cfdd8721d6866 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.905676:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909312.905678:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909312.905680:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.908950:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.908965:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.908984:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.908989:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.908996:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.909016:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.909029:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.909039:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.909102:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909312.909162:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909312.909171:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.909180:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c400 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.909185:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.909195:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.909218:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.909226:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000762e5f6a/0x733cfdd8721d686d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.909252:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.909254:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.909256:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.910491:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.910772:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910790:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.910804:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.910812:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910826:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910836:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910844:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910868:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909312.910887:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909312.910894:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910903:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9da00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.910908:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910918:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910936:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910956:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b7fff6d/0x733cfdd8721d6874 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.910986:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.910988:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.910990:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.912056:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.912067:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.912081:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.912085:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.912091:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.912104:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.913055:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.913068:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.913205:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788909312.913231:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909312.913256:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.913645:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ca00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.913653:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.913664:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.913692:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.913703:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030ab0aff/0x733cfdd8721d687b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.913755:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.913758:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.913762:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788909312.915937:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788909312.916192:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916220:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1788909312.916226:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909312.916236:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916284:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916311:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916319:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916358:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.916381:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.916390:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916398:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6c00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.916403:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916414:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916438:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916457:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d6882 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916485:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.916495:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.916497:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.916619:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.916639:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.916660:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.916666:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.916674:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.916711:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.916726:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.916734:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.916776:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.916783:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.916790:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916800:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d400 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.916804:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916814:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916832:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916841:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092a993ac/0x733cfdd8721d6889 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.916874:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.916877:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.916879:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.917974:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.917986:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.918001:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.918005:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.918010:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.918025:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.918034:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.918055:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.918083:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788909312.918988:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.918996:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.919010:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.919015:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.919020:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.919034:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.919045:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.919053:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.919064:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788909312.920228:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788909312.920249:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920268:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9d600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.920275:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920302:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920339:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920347:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3dbc056/0x733cfdd8721d6890 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920380:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.920384:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920390:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9ce00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.920393:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920401:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920411:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920418:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8d44f05/0x733cfdd8721d6897 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920457:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.920459:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.920461:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788909312.920950:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788909312.920958:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.920977:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1788909312.920982:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909312.921217:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921308:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.921322:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921345:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890504d9c600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.921350:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921362:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921397:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921405:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075ba455d/0x733cfdd8721d682e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921434:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.921436:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.921439:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.921455:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.921457:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.921763:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.921772:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921785:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.921789:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.921795:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921821:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921831:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921839:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.921860:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788909312.922711:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.922722:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922734:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.922739:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.922744:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922753:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922760:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922782:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922801:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788909312.922812:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788909312.922818:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922826:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.922832:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922842:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922860:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922868:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e54b55a6/0x733cfdd8721d68a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922891:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909312.922895:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922916:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909312.922919:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922927:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922938:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922946:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452d6ea4/0x733cfdd8721d68ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.922959:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.922961:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.922963:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.923210:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.923231:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.923239:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.923368:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.923482:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788909312.923647:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.923657:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.923667:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788909312.923672:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.923678:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.923688:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.923705:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.923714:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788909312.925028:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788909312.925039:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.925067:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1788909312.925072:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909312.925080:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.925096:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.925137:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.925147:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.925679:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788909312.925691:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.925702:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909312.925708:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.925720:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.925757:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.925765:0:15934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0a78eee/0x733cfdd8721d689e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.926135:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788909312.926143:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.926167:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670400 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.926171:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.926179:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.926193:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.926204:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909312.926208:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.926214:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.926218:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.926226:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.926240:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.926248:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.926255:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.926258:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.926994:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788909312.927015:0:15154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587001c9/0x733cfdd8721d68b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.927220:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788909312.927597:0:15931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034f847b9/0x733cfdd8721d68ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.927639:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.927958:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788909312.931593:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788909312.931616:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.931638:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788909312.931642:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909312.931650:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.931681:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.931693:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.931702:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.931734:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788909312.932496:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.932731:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.932752:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.932758:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.932765:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.932788:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.932803:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.932837:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.932887:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788909312.933373:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788909312.933390:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933407:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a6c00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.933416:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933430:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933473:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933481:0:15934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092aec648/0x733cfdd8721d68c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933519:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788909312.933524:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933533:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670e00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909312.933537:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933562:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933575:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933584:0:15934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ca52eee/0x733cfdd8721d68c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909312.933606:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.933608:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909312.933610:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.934137:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788909312.934800:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788909312.934814:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.934835:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788909312.934840:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909312.934848:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.934864:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.934874:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.934895:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.934926:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.934943:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.934950:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909312.936322:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.936343:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.936377:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.936385:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.936393:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.936411:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.936422:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.936430:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.936484:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.937155:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7400 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.937165:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.937181:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788909312.937204:0:15154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788909312.937211:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.937214:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.937223:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041ac29c7/0x733cfdd8721d68cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.937239:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.937243:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.937249:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.937261:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.937271:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.937278:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.937298:0:15154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1788909312.937684:0:15154:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000004:00080000:0.0:1788909312.937765:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788909312.937796:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788909312.937822:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14492:x1875807019559808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 86947us (87177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909312.937835:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788909312.937922:0:14492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14492:1875807019559808:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788909312.937946:0:14492:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788909312.937999:0:14492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14492:1875807019560192:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788909312.938032:0:14492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909312.938094:0:14492:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502f70d80 going to sleep for 11 seconds 00010000:00010000:3.0:1788909312.938164:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788909312.938174:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938200:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402671a00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.938204:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938213:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938229:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938237:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b865776/0x733cfdd8721d68d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938259:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.938262:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938266:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402671800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.938269:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938276:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938285:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938300:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f132ecac/0x733cfdd8721d68dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.938314:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.938316:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.938318:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.938329:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.938331:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.938333:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909312.938413:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019560192 00000100:00100000:0.0:1788909312.938426:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019560192 00000100:00100000:0.0:1788909312.938505:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788909312.938517:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14492:x1875807019560192:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788909312.938584:0:15153:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1788909312.938652:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.939953:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.939967:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.939988:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.939993:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.940001:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.940015:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.940025:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.940034:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.940068:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788909312.940977:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.940987:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941000:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.941004:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.941010:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941035:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941046:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941053:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941071:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788909312.941536:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788909312.941553:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941569:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402671200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.941576:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941589:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941625:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941633:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a007419/0x733cfdd8721d68e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941685:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.941691:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941697:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670400 already unused, calling callback (ffffffffc156a250) 00002000:00010000:2.0:1788909312.941701:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788909312.941702:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941722:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941727:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941767:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788909312.941772:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941774:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.941792:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941795:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000587001c9/0x733cfdd8721d68eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941842:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941843:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.941847:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.941852:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.941863:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.941867:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909312.941890:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.941922:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.942041:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.942049:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.942058:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.942069:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.942078:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.942091:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.942099:0:15934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452d6ea4/0x733cfdd8721d68f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.942146:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.942148:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.942149:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.945219:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.945234:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.945258:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.945263:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.945272:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.945291:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.945313:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.945324:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.947585:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788909312.949803:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.949818:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.949843:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.949848:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.949857:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.949876:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.949889:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.949898:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.950854:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788909312.951858:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.951869:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.951886:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.951891:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.951897:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.951912:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.951940:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.951948:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.952097:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788909312.952221:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788909312.952237:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952251:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.952259:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952276:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952307:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952328:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e54b55a6/0x733cfdd8721d68f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952360:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788909312.952364:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952371:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402671e00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.952374:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952382:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952391:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952399:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac0bf33/0x733cfdd8721d6900 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952413:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.952416:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952423:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670c00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.952431:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952438:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952458:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952466:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da889b9/0x733cfdd8721d6907 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.952486:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.952487:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.952492:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.952511:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.952538:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.953043:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.953052:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953066:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.953070:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.953075:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953097:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953106:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953157:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953189:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788909312.953843:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.953849:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953859:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.953862:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.953867:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953877:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953886:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953893:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.953911:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788909312.954102:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788909312.954206:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954221:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402671000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.954226:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954238:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954284:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954294:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097c9342b/0x733cfdd8721d690e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954336:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.954341:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954348:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402671600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.954352:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954360:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954370:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954376:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007385f193/0x733cfdd8721d6915 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.954401:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.954406:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.954416:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.954431:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.954895:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.954906:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.954921:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.954936:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.954943:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.954957:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.954965:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.954973:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.955002:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.955230:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.955240:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.955251:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.955257:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.955267:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.955291:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.955299:0:15934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047dcdc6f/0x733cfdd8721d691c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.955321:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.955323:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.955325:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.956481:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.956492:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.956518:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.956522:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.956529:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.956546:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.956557:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.956577:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.956608:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.956631:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.956642:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.956654:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402671c00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.956658:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.956683:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.956708:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.956717:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fa1f1b/0x733cfdd8721d6923 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.956751:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.956754:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.956758:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.957219:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.957227:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.957239:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.957243:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.957247:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.957257:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.957268:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.957276:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.957305:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.957339:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.957349:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.957360:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402671400 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.957366:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.957376:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.957394:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.957417:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000344d8d2c/0x733cfdd8721d692a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.957454:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.957457:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.957459:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.958928:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.958941:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.958963:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.958967:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.958973:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.958986:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.958996:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.959004:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.959037:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.959085:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.959102:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.959198:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670a00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.959205:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.959218:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.959242:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.959252:0:15934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015daf61f/0x733cfdd8721d6931 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.959291:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.959293:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.959295:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909312.959533:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14492:x1875807019560192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 21009us (21490us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788909312.959547:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00010000:2.0:1788909312.959765:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.959774:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.959785:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.959788:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.959793:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.959804:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.959825:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.959833:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.959849:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788909312.960131:0:14492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14492:1875807019560192:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788909312.960215:0:14492:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788909312.960240:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.960248:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.960259:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890402670800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.960264:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.960275:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.960297:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.960306:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059e028fc/0x733cfdd8721d6938 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.960327:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.960329:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.960330:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.960960:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.960971:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.960983:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.960987:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.960994:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.961007:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.961016:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.961023:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.961056:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.961087:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.961096:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.961678:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9ae00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.961693:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.961707:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.961728:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.961735:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc7ac92/0x733cfdd8721d693f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.961759:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.961760:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.961762:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.962197:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.962205:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.962220:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.962224:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.962231:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.962244:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.962253:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.962261:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.962284:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.963104:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.963205:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.963219:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9ba00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.963224:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.963236:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.963261:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.963286:0:15934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092579ed0/0x733cfdd8721d6946 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.963316:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.963318:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.963320:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.964088:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.964103:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.964152:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.964166:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.964173:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.964187:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.964197:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.964205:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.964230:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.965774:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.965791:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.965808:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9b800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.965814:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.965827:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.965850:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.965859:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002198321b/0x733cfdd8721d694d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.965887:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.965889:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.965891:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.970062:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.970085:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.970156:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.970161:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.970170:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.970186:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.970197:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.970215:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.970242:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.970289:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.970304:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.970320:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9b200 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.970326:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.970340:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.970373:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.970382:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e06bf8af/0x733cfdd8721d6954 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.970417:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.970420:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.970422:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.971207:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.971217:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.971231:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.971235:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.971240:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.971254:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.971264:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.971274:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.971326:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788909312.971456:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909312.971470:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.971483:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9be00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909312.971487:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.971498:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.971538:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.971547:0:15934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008725b33d/0x733cfdd8721d695b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909312.971583:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909312.971586:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909312.971589:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.972011:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.972020:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.972037:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.972041:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.972045:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.972056:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.972064:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.972071:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.972094:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.972232:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.972242:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.972253:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9ac00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.972257:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.972284:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.972301:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.972309:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be55cbb7/0x733cfdd8721d6962 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.972331:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.972333:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.972335:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.972935:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.972944:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.972956:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.972960:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.972965:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.972974:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.972998:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.973005:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.973029:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.973279:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.973289:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.973301:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9b000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.973304:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.973314:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.973334:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.973359:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d64390d8/0x733cfdd8721d6969 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.973383:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.973385:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.973387:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.975100:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.975158:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.975178:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.975183:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.975190:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.975208:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.975220:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.975229:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.975536:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.975573:0:15934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.975589:0:15934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.975602:0:15934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9b600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.975608:0:15934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.975621:0:15934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.975649:0:15934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.975657:0:15934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092a554e9/0x733cfdd8721d6970 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.975695:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.975697:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.975701:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909312.976790:0:15931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788909312.976801:0:15931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.976815:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788909312.976820:0:15931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909312.976827:0:15931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.976841:0:15931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.976850:0:15931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.976858:0:15931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909312.976887:0:15931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788909312.976993:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909312.977004:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.977017:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9a000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909312.977023:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.977034:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.977056:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.977063:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064fd283b/0x733cfdd8721d6977 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909312.977101:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.977103:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909312.977105:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788909312.977156:0:15931:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1788909312.977276:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14490:x1875807019560064:12345-0@lo:5:osp-pre-0-0.0 Request processed in 110431us (120785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909312.977286:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909312.977392:0:14490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14490:1875807019560064:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788909312.977420:0:14490:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788909312.977514:0:14490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14490:1875807019560320:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788909312.977584:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909312.977657:0:14490:0:(client.c:2715:ptlrpc_set_wait()) set ffff890537986000 going to sleep for 11 seconds 00000100:00100000:2.0:1788909312.977664:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019560320 00000100:00100000:2.0:1788909312.977690:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019560320 00000100:00100000:2.0:1788909312.977753:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788909312.977763:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14490:x1875807019560320:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788909312.977818:0:15154:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1788909312.992104:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14490:x1875807019560320:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14329us (14507us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788909312.992164:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788909312.992594:0:14490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14490:1875807019560320:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788909312.992632:0:14490:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 10000000:01000000:0.0:1788909313.226706:0:14465:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788909313.226719:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89053c610000 from 8 10000000:01000000:0.0:1788909313.226727:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788909313.226796:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c516a00/0x733cfdd8721d697e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909313.226811:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c516a00/0x733cfdd8721d697e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909313.226826:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c516a00/0x733cfdd8721d697e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909313.226862:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019560448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788909313.226961:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909313.227039:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905088779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909313.227153:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019560448 00000100:00100000:2.0:1788909313.227166:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019560448 00000100:00100000:2.0:1788909313.227260:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788909313.227273:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:14465:x1875807019560448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909313.227294:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909313.227317:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890401a9b400/0x733cfdd8721d6985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d697e expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909313.227355:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890401a9b400/0x733cfdd8721d6985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d697e expref: 19 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909313.227370:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890401a9b400/0x733cfdd8721d6985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d697e expref: 19 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909313.227382:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9b400, rc 0) 00000100:00100000:2.0:1788909313.227449:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:14465:x1875807019560448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909313.227457:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788909313.227530:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053c8e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019560448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788909313.227549:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c516a00/0x733cfdd8721d697e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6985 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909313.227581:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c516a00/0x733cfdd8721d697e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d6985 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909313.227655:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019560576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788909313.227690:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909313.227704:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890502f70300 going to sleep for 11 seconds 00000100:00100000:2.0:1788909313.227719:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019560576 00000100:00100000:2.0:1788909313.227722:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019560576 00000100:00100000:2.0:1788909313.227742:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788909313.227748:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:14465:x1875807019560576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788909313.227764:0:14462:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788909313.227786:0:14462:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788909313.227790:0:14462:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788909313.227873:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:14465:x1875807019560576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909313.227880:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788909313.227908:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019560576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788909313.227975:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788909313.227982:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c516a00/0x733cfdd8721d697e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6985 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909313.227990:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c516a00/0x733cfdd8721d697e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6985 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909313.606398:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909314.633393:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788909314.766291:0:6701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788909314.766363:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788909315.654611:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909316.679655:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788909317.434687:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788909317.434744:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788909317.707296:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788909317.919304:0:16226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788909318.282099:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788909318.289477:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788909318.289504:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019560960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909318.289585:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909318.289961:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019560832:0@lo:400:kworker.0 00000100:00100000:1.0:1788909318.290007:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909318.290040:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019560832 00000100:00100000:1.0:1788909318.290049:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019560832 00000100:00100000:1.0:1788909318.290102:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788909318.290183:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3284:x1875807019560832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909318.290248:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3284:x1875807019560832:12345-0@lo:400:kworker.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909318.290255:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788909318.290307:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019560832:0@lo:400:kworker.0 00000100:00100000:1.0:1788909318.290316:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019560704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788909318.290367:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909318.292163:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788909318.292191:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019561088:0@lo:400:kworker.0 00000100:00100000:3.0:1788909318.292272:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909318.292319:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019560960 00000100:00100000:3.0:1788909318.292329:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019560960 00000100:00100000:3.0:1788909318.292406:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019560704 00000100:00100000:3.0:1788909318.292410:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019560704 00000100:00100000:3.0:1788909318.292434:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788909318.292446:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019560960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788909318.292498:0:15156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909318.292552:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019560960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909318.292561:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788909318.292583:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909318.292589:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019560704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909318.292610:0:15156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909318.292640:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019560704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909318.292666:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788909318.292706:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019561216:0@lo:400:kworker.0 00000100:00100000:3.0:1788909318.292734:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909318.292757:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788909318.292762:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019561344:0@lo:400:kworker.0 00000100:00100000:3.0:1788909318.292780:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909318.292808:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019561088 00000100:00100000:3.0:1788909318.292811:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019561088 00000100:00100000:3.0:1788909318.292838:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019561216 00000100:00100000:3.0:1788909318.292841:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019561216 00000100:00100000:3.0:1788909318.292855:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019561344 00000100:00100000:3.0:1788909318.292856:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019561344 00000100:00100000:3.0:1788909318.292870:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788909318.292875:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019561088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909318.292905:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019561088:12345-0@lo:400:kworker.0 Request processed in 30us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909318.292911:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788909318.292921:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788909318.292927:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019561216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909318.292949:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875807019561216:12345-0@lo:400:kworker.0 Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909318.292955:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788909318.292964:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788909318.292971:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019561344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909318.292991:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019561344:12345-0@lo:400:kworker.0 Request processed in 22us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909318.293004:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788909318.293022:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788909318.293026:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788909318.293029:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788909318.293068:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905344db100 x1875807019561088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909318.293085:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019561088:0@lo:400:kworker.0 00010000:00080000:3.0:1788909318.293154:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905344d8000 x1875807019561344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909318.293163:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019561344:0@lo:400:kworker.0 00010000:00080000:3.0:1788909318.293172:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8905344d9180 x1875807019561216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788909334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788909318.293180:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875807019561216:0@lo:400:kworker.0 00000100:00100000:3.0:1788909318.293210:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788909318.293232:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019560960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788909318.293260:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788909318.293270:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019560704:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788909318.728322:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788909319.174996:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788909319.749685:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909320.248438:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909320.248531:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004891520 00000100:00100000:0.0:1788909320.248543:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004891520 00000100:00100000:0.0:1788909320.248596:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:0.0:1788909320.248620:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1875807004891520:12345-192.168.204.54@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788909320.248647:0:14463:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053@192.168.204.54@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:0.0:1788909320.248677:0:14463:0:(genops.c:1385:class_connect()) connect: client d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053, cookie 0x733cfdd8721d698c 00000100:00080000:0.0:1788909320.248821:0:14463:0:(import.c:65:import_set_state_nolock()) ffff890518340000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788909320.248901:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+5:2346:x1875807004891520:12345-192.168.204.54@tcp:250:mount.lustre.0 Request processed in 281us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909320.248908:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1788909320.272483:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.272600:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004891648 00000100:00100000:2.0:1788909320.272611:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004891648 00000100:00100000:2.0:1788909320.272670:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:2.0:1788909320.272681:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+5:13763:x1875807004891648:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788909320.272698:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909320.272716:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890401a9b600/0x733cfdd8721d6993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a44929 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909320.272744:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890401a9b600/0x733cfdd8721d6993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44929 expref: 6 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909320.272754:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890401a9b600/0x733cfdd8721d6993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44929 expref: 6 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909320.272763:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9b600, rc 0) 00000100:00100000:2.0:1788909320.272825:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+6:13763:x1875807004891648:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 147us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.272833:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:3.0:1788909320.283208:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.283635:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004891776 00000100:00100000:2.0:1788909320.283647:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004891776 00000100:00100000:2.0:1788909320.283708:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:2.0:1788909320.283719:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+6:13763:x1875807004891776:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788909320.285134:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+6:13763:x1875807004891776:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 1382us (1906us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788909320.285166:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:3.0:1788909320.290517:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909320.293493:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004891904 00000100:00100000:0.0:1788909320.293509:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004891904 00000100:00100000:0.0:1788909320.293591:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:0.0:1788909320.293604:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+6:13763:x1875807004891904:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788909320.293623:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909320.293642:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89053c517000/0x733cfdd8721d699a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a44930 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909320.293671:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89053c517000/0x733cfdd8721d699a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44930 expref: 7 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909320.293684:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89053c517000/0x733cfdd8721d699a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44930 expref: 7 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909320.293693:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517000, rc 0) 00000100:00100000:0.0:1788909320.293824:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+7:13763:x1875807004891904:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 222us (3321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909320.293831:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:3.0:1788909320.301391:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.301481:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004892032 00000100:00100000:2.0:1788909320.301492:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004892032 00000100:00100000:2.0:1788909320.301561:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:2.0:1788909320.301572:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+7:13763:x1875807004892032:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788909320.301880:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+8:13763:x1875807004892032:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 308us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.301888:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:0.0:1788909320.304898:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.305099:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004892160 00000100:00100000:2.0:1788909320.305141:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004892160 00000100:00100000:2.0:1788909320.305279:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:2.0:1788909320.305290:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890509092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+8:13763:x1875807004892160:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788909320.305737:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890509092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+8:13763:x1875807004892160:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 447us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.305746:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 80 00000100:00100000:3.0:1788909320.318288:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909320.318453:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004892288 00000100:00100000:0.0:1788909320.318472:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004892288 00000100:00100000:0.0:1788909320.318545:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:0.0:1788909320.318555:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+8:13782:x1875807004892288:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788909320.318842:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+8:13782:x1875807004892288:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 287us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909320.318850:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 81 00000100:00100000:3.0:1788909320.356601:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.356691:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004892416 00000100:00100000:2.0:1788909320.356704:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004892416 00000100:00100000:2.0:1788909320.356829:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1788909320.356841:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+8:13782:x1875807004892416:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788909320.357579:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+8:13782:x1875807004892416:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 735us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.357589:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 82 00000100:00100000:2.0:1788909320.362483:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909320.363227:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004892544 00000100:00100000:1.0:1788909320.363238:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004892544 00000100:00100000:1.0:1788909320.363319:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:1.0:1788909320.363330:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+8:13763:x1875807004892544:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788909320.363346:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909320.363362:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89053c769600/0x733cfdd8721d69a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a4495a expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909320.363391:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89053c769600/0x733cfdd8721d69a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4495a expref: 9 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909320.363402:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89053c769600/0x733cfdd8721d69a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4495a expref: 9 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909320.363412:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769600, rc 0) 00000100:00100000:1.0:1788909320.363474:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+9:13763:x1875807004892544:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 146us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909320.363481:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 83 00000100:00100000:0.0:1788909320.367978:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.368078:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004892672 00000100:00100000:2.0:1788909320.368103:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004892672 00000100:00100000:2.0:1788909320.368189:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:2.0:1788909320.368199:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+9:13763:x1875807004892672:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788909320.368223:0:14460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788909320.368240:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788909320.368245:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788909320.368253:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788909320.368256:0:14460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788909320.374394:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+9:13763:x1875807004892672:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 6185us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.374409:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 84 00000100:00100000:0.0:1788909320.382826:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909320.383574:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004892800 00000100:00100000:3.0:1788909320.383585:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004892800 00000100:00100000:3.0:1788909320.383647:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1788909320.383657:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+9:13763:x1875807004892800:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788909320.383681:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909320.383698:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a44961 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909320.383726:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44961 expref: 10 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909320.383737:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44961 expref: 10 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909320.383747:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7000, rc 0) 00000100:00100000:3.0:1788909320.383816:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13763:x1875807004892800:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 160us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909320.383823:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:3.0:1788909320.388625:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.388964:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004892928 00000100:00100000:2.0:1788909320.388976:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004892928 00000100:00100000:2.0:1788909320.389379:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1788909320.389391:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13763:x1875807004892928:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788909320.389705:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13763:x1875807004892928:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 316us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.389713:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:2.0:1788909320.392773:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909320.392863:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004893056 00000100:00100000:1.0:1788909320.392872:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004893056 00000100:00100000:1.0:1788909320.393387:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:1.0:1788909320.393399:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13763:x1875807004893056:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788909320.393675:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13763:x1875807004893056:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 275us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909320.393684:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:0.0:1788909320.404656:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.412527:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004893184 00000100:00100000:2.0:1788909320.412547:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004893184 00000100:00100000:2.0:1788909320.412626:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:2.0:1788909320.416013:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13786:x1875807004893184:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788909320.416427:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13786:x1875807004893184:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 3790us (11877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.416440:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:0.0:1788909320.439589:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909320.439687:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004893312 00000100:00100000:1.0:1788909320.439701:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004893312 00000100:00100000:1.0:1788909320.439776:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:1.0:1788909320.439787:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13786:x1875807004893312:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788909320.440105:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13786:x1875807004893312:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 319us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909320.440149:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 89 00000100:00100000:0.0:1788909320.455634:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909320.455733:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004893440 00000100:00100000:3.0:1788909320.455744:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004893440 00000100:00100000:3.0:1788909320.455803:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788909320.455811:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2346:x1875807004893440:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788909320.455842:0:15177:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 17266de6-98eb-4db6-abc9-b5293f8b8e05@192.168.204.54@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:3.0:1788909320.455896:0:15177:0:(genops.c:1385:class_connect()) connect: client 17266de6-98eb-4db6-abc9-b5293f8b8e05, cookie 0x733cfdd8721d69af 00000004:00100000:3.0:1788909320.455929:0:15177:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788909320.455958:0:15177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788909320.502674:0:15177:0:(import.c:65:import_set_state_nolock()) ffff890518346800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788909320.502779:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:2346:x1875807004893440:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 46965us (47154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909320.502792:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788909320.506783:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909320.506869:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.507625:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004893568 00000100:00100000:2.0:1788909320.507641:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004893568 00000100:00100000:2.0:1788909320.507735:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004893696 00000100:00100000:2.0:1788909320.507739:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004893696 00000100:00100000:2.0:1788909320.507769:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1788909320.507781:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:0:x1875807004893568:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788909320.507843:0:14467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788909320.508011:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909320.508150:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788909320.508165:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:13763:x1875807004893696:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788909320.508183:0:14468:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788909320.508267:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:13763:x1875807004893696:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 107us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909320.508276:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788909320.509575:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:0:x1875807004893568:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 1788us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.509589:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788909320.510494:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909320.510732:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004893824 00000100:00100000:1.0:1788909320.510741:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004893824 00000100:00100000:1.0:1788909320.510791:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788909320.510801:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:13763:x1875807004893824:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788909320.510871:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:13763:x1875807004893824:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 72us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909320.510878:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788909320.514901:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909320.514956:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909320.514990:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909320.515351:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004894208 00000100:00100000:1.0:1788909320.515365:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004894208 00000100:00100000:1.0:1788909320.515446:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788909320.515463:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:13763:x1875807004894208:12345-192.168.204.54@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788909320.515481:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004893952 00000100:00100000:2.0:1788909320.515486:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004893952 00000100:00100000:2.0:1788909320.515794:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004894080 00000100:00100000:2.0:1788909320.515799:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004894080 00000100:00100000:2.0:1788909320.515818:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:2.0:1788909320.515824:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875807004893952:12345-192.168.204.54@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788909320.515844:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00010000:00080000:2.0:1788909320.515849:0:15931:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 17266de6-98eb-4db6-abc9-b5293f8b8e05@192.168.204.54@tcp t0 exp 0000000000000000 cur 402 last 0 00000100:00100000:1.0:1788909320.515865:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875807004894080:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788909320.515878:0:15153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 17266de6-98eb-4db6-abc9-b5293f8b8e05@192.168.204.54@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:2.0:1788909320.515882:0:15931:0:(genops.c:1385:class_connect()) connect: client 17266de6-98eb-4db6-abc9-b5293f8b8e05, cookie 0x733cfdd8721d69b6 00002000:00100000:2.0:1788909320.515893:0:15931:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 17266de6-98eb-4db6-abc9-b5293f8b8e05/ffff8905068d9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:1.0:1788909320.515898:0:15153:0:(genops.c:1385:class_connect()) connect: client 17266de6-98eb-4db6-abc9-b5293f8b8e05, cookie 0x733cfdd8721d69bd 00002000:00100000:1.0:1788909320.515902:0:15153:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 17266de6-98eb-4db6-abc9-b5293f8b8e05/ffff8904035cb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788909320.515915:0:15931:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788909320.515929:0:15153:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788909320.516312:0:15153:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788909320.516344:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8904035ca000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788909320.516433:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:2346:x1875807004894080:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 566us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909320.516442:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000004:00080000:3.0:1788909320.517650:0:14470:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1830us 00002000:00080000:2.0:1788909320.518088:0:15931:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788909320.518415:0:15931:0:(import.c:65:import_set_state_nolock()) ffff8905104d5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788909320.518534:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:2346:x1875807004893952:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 2701us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.518549:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000004:00200000:1.0:1788909320.533430:0:14470:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788909320.533654:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:13763:x1875807004894208:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 18187us (18688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909320.533668:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788909320.719650:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909320.719788:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004894336 00000100:00100000:2.0:1788909320.719817:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004894336 00000100:00100000:2.0:1788909320.719962:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788909320.719975:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:13807:x1875807004894336:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:2.0:1788909320.719999:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909320.721394:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d69c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a4498b expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909320.721489:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d69cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909320.721505:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d69cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909320.721523:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d69cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909320.721981:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788909320.721986:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909320.722142:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d69cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909320.722178:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d69c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4498b expref: 8 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909320.722392:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d69cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4498b expref: 7 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909320.722402:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693bb00) 00010000:00010000:2.0:1788909320.722405:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909320.722409:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9a800, rc 0) 00000100:00100000:2.0:1788909320.722498:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:13807:x1875807004894336:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 2526us (2862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909320.722508:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:3.0:1788909320.774530:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909321.797375:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788909322.433498:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17266de6-98eb-4db6-abc9-b5293f8b8e05 00000100:00100000:0.0:1788909322.696589:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909322.696703:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004894464 00000100:00100000:3.0:1788909322.696714:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004894464 00000100:00080000:0.0:1788909322.696882:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909322.696955:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788909322.696968:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:13860:x1875807004894464:12345-192.168.204.54@tcp:41:lfs.0 00000004:00000024:3.0:1788909322.697028:0:14469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788909322.697301:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:13860:x1875807004894464:12345-192.168.204.54@tcp:41:lfs.0 Request processed in 335us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909322.697309:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788909322.703350:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909322.703454:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004894592 00000100:00100000:3.0:1788909322.703465:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004894592 00000100:00100000:3.0:1788909322.703589:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788909322.703601:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:13860:x1875807004894592:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:3.0:1788909322.703638:0:15156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909322.703724:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:13860:x1875807004894592:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 125us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909322.703732:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00080000:0.0:1788909322.703922:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788909322.713237:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909322.713542:0:15157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004894720 00000100:00100000:1.0:1788909322.713560:0:15157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004894720 00000100:00100000:1.0:1788909322.713687:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788909322.713700:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:13860:x1875807004894720:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:1.0:1788909322.713752:0:15157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788909322.713825:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788909322.713881:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:13860:x1875807004894720:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 174us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909322.713892:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00010000:00010000:3.0:1788909322.821815:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909322.893087:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909322.893346:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004894848 00000100:00100000:3.0:1788909322.893360:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004894848 00000100:00100000:3.0:1788909322.893444:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:3.0:1788909322.893457:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+10:13895:x1875807004894848:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788909322.893495:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909322.893522:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a7400/0x733cfdd8721d69d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a44992 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909322.893563:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a7400/0x733cfdd8721d69d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44992 expref: 11 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909322.893576:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a7400/0x733cfdd8721d69d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44992 expref: 11 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909322.893588:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7400, rc 0) 00000100:00100000:3.0:1788909322.893670:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13895:x1875807004894848:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 216us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909322.893678:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 90 00000100:00100000:0.0:1788909322.902209:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909322.902322:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004894976 00000100:00100000:2.0:1788909322.902336:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004894976 00000100:00100000:2.0:1788909322.902409:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:2.0:1788909322.902430:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13895:x1875807004894976:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788909322.902963:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13895:x1875807004894976:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 540us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909322.902975:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 91 00000100:00100000:0.0:1788909322.905781:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909322.905932:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004895104 00000100:00100000:1.0:1788909322.905964:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004895104 00000100:00100000:1.0:1788909322.906050:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1788909322.906062:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13895:x1875807004895104:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788909322.906921:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13895:x1875807004895104:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 845us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909322.906935:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 92 00000100:00100000:1.0:1788909322.912149:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909322.912327:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004895232 00000100:00100000:3.0:1788909322.912347:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004895232 00000100:00100000:3.0:1788909322.912475:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:3.0:1788909322.912491:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13900:x1875807004895232:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788909322.913213:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13900:x1875807004895232:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 720us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909322.913225:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 93 00000100:00100000:0.0:1788909322.928077:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909322.928613:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004895360 00000100:00100000:1.0:1788909322.928631:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004895360 00000100:00100000:1.0:1788909322.928736:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:1.0:1788909322.928752:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13900:x1875807004895360:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788909322.929712:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13900:x1875807004895360:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 954us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909322.929726:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 94 00000100:00100000:0.0:1788909322.937576:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909322.938499:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004895488 00000100:00100000:3.0:1788909322.938514:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004895488 00000100:00100000:3.0:1788909322.938595:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:3.0:1788909322.938605:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13895:x1875807004895488:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788909322.938627:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909322.938667:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a7200/0x733cfdd8721d69d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a449bc expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909322.938706:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a7200/0x733cfdd8721d69d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449bc expref: 12 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909322.938718:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a7200/0x733cfdd8721d69d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449bc expref: 12 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909322.938729:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7200, rc 0) 00000100:00100000:3.0:1788909322.938813:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13895:x1875807004895488:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 208us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909322.938821:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:2.0:1788909322.948787:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909322.948931:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004895616 00000100:00100000:1.0:1788909322.948952:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004895616 00000100:00100000:1.0:1788909322.949049:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:1.0:1788909322.949062:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890534a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13895:x1875807004895616:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788909322.949101:0:14462:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788909322.949174:0:14462:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788909322.949180:0:14462:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788909322.949184:0:14462:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788909322.949186:0:14462:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788909322.954014:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890534a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13895:x1875807004895616:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 4930us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909322.954271:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:0.0:1788909322.959225:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909322.960093:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004895744 00000100:00100000:2.0:1788909322.960136:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004895744 00000100:00100000:2.0:1788909322.960216:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:2.0:1788909322.960228:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13895:x1875807004895744:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788909322.960260:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909322.960285:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a449c3 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909322.960325:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449c3 expref: 13 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909322.960338:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449c3 expref: 13 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909322.960348:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9a400, rc 0) 00000100:00100000:2.0:1788909322.960508:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13895:x1875807004895744:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 282us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909322.960516:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 97 00000100:00100000:2.0:1788909322.966798:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909322.966953:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004895872 00000100:00100000:1.0:1788909322.966970:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004895872 00000100:00100000:1.0:1788909322.967086:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:1.0:1788909322.967099:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13895:x1875807004895872:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788909322.967849:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13895:x1875807004895872:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 749us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909322.968165:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 98 00000100:00100000:0.0:1788909322.971468:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909322.971581:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004896000 00000100:00100000:3.0:1788909322.971595:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004896000 00000100:00100000:3.0:1788909322.971738:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:3.0:1788909322.971752:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13895:x1875807004896000:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788909322.972605:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13895:x1875807004896000:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 849us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909322.972619:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 99 00000100:00100000:2.0:1788909322.977635:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909322.977811:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004896128 00000100:00100000:1.0:1788909322.977825:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004896128 00000100:00100000:1.0:1788909322.977914:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:1.0:1788909322.977927:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13903:x1875807004896128:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788909322.978433:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13903:x1875807004896128:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 507us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909322.978445:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 100 00000100:00100000:1.0:1788909322.988833:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909322.988978:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004896256 00000100:00100000:2.0:1788909322.988992:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004896256 00000100:00100000:2.0:1788909322.989181:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:2.0:1788909322.989195:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13903:x1875807004896256:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788909322.989887:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13903:x1875807004896256:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 690us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909322.989899:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 101 00000100:00100000:0.0:1788909322.995325:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909322.995385:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909322.995913:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004896896 00000100:00100000:3.0:1788909322.995930:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004896896 00000100:00100000:2.0:1788909322.996258:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004896384 00000100:00100000:2.0:1788909322.996264:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004896384 00000100:00100000:2.0:1788909322.996324:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1788909322.996336:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2346:x1875807004896384:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788909322.996381:0:15177:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 00072612-ab86-4466-947e-4aecf4863d3a@192.168.204.54@tcp t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:2.0:1788909322.996438:0:15177:0:(genops.c:1385:class_connect()) connect: client 00072612-ab86-4466-947e-4aecf4863d3a, cookie 0x733cfdd8721d69e7 00000004:00100000:2.0:1788909322.996487:0:15177:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788909322.996764:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909322.996981:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004896768 00000100:00100000:1.0:1788909322.997138:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788909322.997157:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:2347:x1875807004896896:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909322.997276:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:2347:x1875807004896896:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 127us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909322.997285:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788909322.998187:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004896768 00000100:00100000:0.0:1788909322.998293:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909322.998463:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004897024 00000100:00100000:3.0:1788909322.998468:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004897024 00000100:00100000:3.0:1788909322.998528:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788909322.998538:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2347:x1875807004897024:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909322.998607:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2347:x1875807004897024:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 71us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909322.998615:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00080000:2.0:1788909322.998794:0:15177:0:(import.c:65:import_set_state_nolock()) ffff890510ab5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788909322.998935:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00072612-ab86-4466-947e-4aecf4863d3a+6:2346:x1875807004896384:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 2600us (3629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909322.998944:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788909322.999189:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788909322.999199:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:2347:x1875807004896768:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909322.999233:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:2347:x1875807004896768:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 36us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909322.999261:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788909323.004281:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909323.004347:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909323.004526:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004896512 00000100:00100000:2.0:1788909323.004542:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004896512 00000100:00100000:0.0:1788909323.004972:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004896640 00000100:00100000:0.0:1788909323.004978:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004896640 00000100:00100000:0.0:1788909323.005041:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788909323.005053:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00072612-ab86-4466-947e-4aecf4863d3a+7:0:x1875807004896512:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788909323.005158:0:15177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788909323.005279:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00072612-ab86-4466-947e-4aecf4863d3a+7:0:x1875807004896512:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 227us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909323.005288:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788909323.005312:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788909323.005319:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00072612-ab86-4466-947e-4aecf4863d3a+6:13895:x1875807004896640:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788909323.005332:0:15177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788909323.005358:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00072612-ab86-4466-947e-4aecf4863d3a+6:13895:x1875807004896640:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 40us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909323.005365:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00080000:3.0:1788909323.006219:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909323.007351:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909323.007439:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004897152 00000100:00100000:0.0:1788909323.007450:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004897152 00000100:00100000:0.0:1788909323.008369:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788909323.008390:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00072612-ab86-4466-947e-4aecf4863d3a+6:13895:x1875807004897152:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788909323.008551:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00072612-ab86-4466-947e-4aecf4863d3a+6:13895:x1875807004897152:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 168us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909323.008560:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788909323.015395:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909323.015454:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909323.015582:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004897536 00000100:00100000:3.0:1788909323.015595:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004897536 00000100:00100000:3.0:1788909323.015682:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788909323.015696:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00072612-ab86-4466-947e-4aecf4863d3a+6:13895:x1875807004897536:12345-192.168.204.54@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788909323.015753:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000004:00200000:3.0:1788909323.017201:0:14471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788909323.017483:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00072612-ab86-4466-947e-4aecf4863d3a+6:13895:x1875807004897536:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 1784us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909323.017497:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1788909323.024367:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004897280 00000100:00100000:1.0:1788909323.024392:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004897280 00000100:00100000:1.0:1788909323.024538:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004897408 00000100:00100000:1.0:1788909323.024543:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004897408 00000100:00100000:0.0:1788909323.024598:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788909323.024620:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875807004897280:12345-192.168.204.54@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788909323.024836:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:1.0:1788909323.024844:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875807004897408:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788909323.025026:0:15931:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 00072612-ab86-4466-947e-4aecf4863d3a@192.168.204.54@tcp t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:0.0:1788909323.025075:0:15931:0:(genops.c:1385:class_connect()) connect: client 00072612-ab86-4466-947e-4aecf4863d3a, cookie 0x733cfdd8721d69ee 00002000:00100000:0.0:1788909323.025091:0:15931:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 00072612-ab86-4466-947e-4aecf4863d3a/ffff890518347000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788909323.025107:0:15931:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788909323.025325:0:15931:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788909323.025377:0:15931:0:(import.c:65:import_set_state_nolock()) ffff890518341800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788909323.025477:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00072612-ab86-4466-947e-4aecf4863d3a+6:2346:x1875807004897280:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 866us (10021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909323.025486:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00080000:1.0:1788909323.025988:0:15153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 00072612-ab86-4466-947e-4aecf4863d3a@192.168.204.54@tcp t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:1.0:1788909323.026013:0:15153:0:(genops.c:1385:class_connect()) connect: client 00072612-ab86-4466-947e-4aecf4863d3a, cookie 0x733cfdd8721d69f5 00002000:00100000:1.0:1788909323.026021:0:15153:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 00072612-ab86-4466-947e-4aecf4863d3a/ffff8904035c9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113956 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788909323.026030:0:15153:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788909323.026329:0:15153:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788909323.026354:0:15153:0:(import.c:65:import_set_state_nolock()) ffff8904035cc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788909323.026396:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00072612-ab86-4466-947e-4aecf4863d3a+6:2346:x1875807004897408:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 1551us (10643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909323.026404:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788909323.161091:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909323.161437:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004897664 00000100:00100000:1.0:1788909323.161455:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004897664 00000100:00100000:1.0:1788909323.161959:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788909323.161974:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00072612-ab86-4466-947e-4aecf4863d3a+6:13924:x1875807004897664:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:1.0:1788909323.162000:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909323.162037:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d69fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a449ed expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909323.162188:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909323.162209:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909323.162243:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909323.162572:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788909323.162577:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909323.162693:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909323.162730:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769a00/0x733cfdd8721d69fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449ed expref: 8 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909323.162766:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449ed expref: 7 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909323.162776:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693bb00) 00010000:00010000:1.0:1788909323.162779:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788909323.162783:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768a00, rc 0) 00000100:00100000:1.0:1788909323.162878:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00072612-ab86-4466-947e-4aecf4863d3a+7:13924:x1875807004897664:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 908us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909323.162888:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788909323.398852:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019561472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909323.399729:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890508ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019561600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909323.399834:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909323.400398:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909323.400516:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788909323.400526:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019561984:0@lo:400:kworker.0 00000100:00100000:3.0:1788909323.400568:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909323.400617:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019561856:0@lo:400:kworker.0 00000100:00100000:3.0:1788909323.400644:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909323.400675:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788909323.400682:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019561728:0@lo:400:kworker.0 00000100:00100000:3.0:1788909323.400715:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909323.400755:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019561472 00000100:00100000:3.0:1788909323.400764:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019561472 00000100:00100000:3.0:1788909323.400820:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019561600 00000100:00100000:3.0:1788909323.400823:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019561600 00000100:00100000:3.0:1788909323.400841:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788909323.400849:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019561472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909323.400878:0:15156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788909323.401280:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019561984 00000100:00100000:0.0:1788909323.401287:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019561984 00000100:00100000:0.0:1788909323.401327:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019561856 00000100:00100000:0.0:1788909323.401330:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019561856 00000100:00100000:0.0:1788909323.401352:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788909323.401361:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019561984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909323.401485:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788909323.401498:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875807019561856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909323.401542:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875807019561856:12345-0@lo:400:kworker.0 Request processed in 49us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909323.401550:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788909323.401620:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788909323.401625:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909323.401638:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019561728 00000100:00100000:1.0:1788909323.401643:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019561728 00000100:00100000:1.0:1788909323.401678:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788909323.401685:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3284:x1875807019561728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909323.401719:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3284:x1875807019561728:12345-0@lo:400:kworker.0 Request processed in 35us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909323.401725:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788909323.403407:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019561984:12345-0@lo:400:kworker.0 Request processed in 2035us (2825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909323.403448:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788909323.403619:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019561984:0@lo:400:kworker.0 00000100:00100000:3.0:1788909323.403762:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019561472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2910us (3926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909323.403782:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788909323.403808:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788909323.403824:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019561600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788909323.403859:0:15156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788909323.404322:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019561600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 502us (3924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909323.404330:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788909323.404374:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af89eede-3fcd-45ad-88b4-973cc21df0c9:3284:1875807019561728:0@lo:400:kworker.0 00000100:00100000:3.0:1788909323.404392:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019561856:0@lo:400:kworker.0 00000100:00100000:1.0:1788909323.404499:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019561472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788909323.404568:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890508ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019561600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788909323.404864:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788909323.404967:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019562368:0@lo:400:kworker.0 00000100:00100000:2.0:1788909323.405254:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909323.405293:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788909323.405299:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019562240:0@lo:400:kworker.0 00000100:00100000:2.0:1788909323.405325:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909323.405363:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019562368 00000100:00100000:2.0:1788909323.405372:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019562368 00000100:00100000:2.0:1788909323.405439:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019562240 00000100:00100000:2.0:1788909323.405442:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019562240 00000100:00100000:2.0:1788909323.405468:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788909323.405479:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019562368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909323.405532:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019562368:12345-0@lo:400:kworker.0 Request processed in 55us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909323.405540:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788909323.405556:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788909323.405645:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019562240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909323.405679:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019562240:12345-0@lo:400:kworker.0 Request processed in 117us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909323.405686:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788909323.405707:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788909323.405738:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019562240:0@lo:400:kworker.0 00000100:00100000:2.0:1788909323.405749:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019562368:0@lo:400:kworker.0 00000100:00100000:1.0:1788909323.406045:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019562112:0@lo:400:kworker.0 00000100:00100000:1.0:1788909323.406084:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909323.406259:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019562112 00000100:00100000:2.0:1788909323.406281:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019562112 00000100:00100000:2.0:1788909323.406362:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788909323.406371:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019562112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909323.406421:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019562112:12345-0@lo:400:kworker.0 Request processed in 51us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909323.406428:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788909323.406492:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052df6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019562112:0@lo:400:kworker.0 00010000:00010000:3.0:1788909323.846216:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788909324.870820:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788909324.991233:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00072612-ab86-4466-947e-4aecf4863d3a 00000001:00100000:3.0:1788909324.991256:0:6701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 17266de6-98eb-4db6-abc9-b5293f8b8e05 00010000:00010000:1.0:1788909325.896385:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788909325.977390:0:16430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788909326.004269:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 17266de6-98eb-4db6-abc9-b5293f8b8e05 00000001:00100000:1.0:1788909326.004290:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 00072612-ab86-4466-947e-4aecf4863d3a 00010000:00010000:1.0:1788909326.919283:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788909327.575092:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00072612-ab86-4466-947e-4aecf4863d3a 00010000:00010000:2.0:1788909327.945369:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909328.472697:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909328.473163:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004897920 00000100:00100000:2.0:1788909328.473177:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004897920 00000100:00100000:2.0:1788909328.473269:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788909328.473283:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:2350:x1875807004897920:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909328.473376:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:2350:x1875807004897920:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 96us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909328.473384:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00080000:1.0:1788909328.473644:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909328.479472:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909328.479802:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909328.479822:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909328.479841:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909328.479866:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909328.479888:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909328.479926:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004898304 00000100:00100000:0.0:1788909328.479939:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004898304 00000100:00100000:0.0:1788909328.480014:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788909328.480026:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00072612-ab86-4466-947e-4aecf4863d3a+6:2349:x1875807004898304:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909328.480414:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00072612-ab86-4466-947e-4aecf4863d3a+6:2349:x1875807004898304:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 388us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909328.480423:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788909328.480456:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004898176 00000100:00100000:0.0:1788909328.480460:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004898176 00000100:00100000:0.0:1788909328.480562:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004898048 00000100:00100000:0.0:1788909328.480566:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004898048 00000100:00100000:0.0:1788909328.480582:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004898560 00000100:00100000:0.0:1788909328.480584:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004898560 00000100:00100000:0.0:1788909328.480597:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004898432 00000100:00100000:0.0:1788909328.480599:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004898432 00000100:00100000:0.0:1788909328.480613:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788909328.480619:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2350:x1875807004898176:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909328.480715:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2350:x1875807004898176:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 95us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909328.480790:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788909328.480805:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788909328.480812:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2349:x1875807004898048:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909328.480839:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2349:x1875807004898048:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909328.480846:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788909328.480859:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788909328.480864:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00072612-ab86-4466-947e-4aecf4863d3a+5:2349:x1875807004898560:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909328.480891:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00072612-ab86-4466-947e-4aecf4863d3a+5:2349:x1875807004898560:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909328.480898:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788909328.480909:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788909328.480915:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00072612-ab86-4466-947e-4aecf4863d3a+5:2350:x1875807004898432:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788909328.480938:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00072612-ab86-4466-947e-4aecf4863d3a+5:2350:x1875807004898432:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 23us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909328.480944:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788909328.482392:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004897792 00000100:00100000:1.0:1788909328.482406:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004897792 00000100:00100000:1.0:1788909328.482462:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00100000:1.0:1788909328.482473:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:2349:x1875807004897792:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788909328.482550:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:2349:x1875807004897792:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 79us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909328.482558:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 103 00000100:00080000:1.0:1788909328.482615:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788909328.482621:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788909328.482624:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909328.520406:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788909328.520435:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019562496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909328.520520:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909328.520582:0:15157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019562496 00000100:00100000:2.0:1788909328.520595:0:15157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019562496 00000100:00080000:0.0:1788909328.520638:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909328.520678:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788909328.520690:0:15156:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788909328.520691:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019562496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788909328.520703:0:15156:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1788909328.520736:0:15157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909328.520790:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019562496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909328.520799:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788909328.520882:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019562496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909328.521090:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788909328.521103:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019562880:0@lo:400:kworker.0 00000100:00100000:2.0:1788909328.521183:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909328.521204:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019562752:0@lo:400:kworker.0 00000100:00100000:2.0:1788909328.521238:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909328.521383:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019562880 00000100:00100000:2.0:1788909328.521389:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019562880 00000100:00100000:2.0:1788909328.521429:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788909328.521437:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019562880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788909328.521484:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875807019562880:12345-0@lo:400:kworker.0 Request processed in 47us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909328.521493:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788909328.521507:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019562752 00000100:00100000:0.0:1788909328.521512:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019562752 00000100:00100000:2.0:1788909328.521530:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875807019562880:0@lo:400:kworker.0 00000100:00100000:0.0:1788909328.521557:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788909328.521566:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019562752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909328.521609:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875807019562752:12345-0@lo:400:kworker.0 Request processed in 44us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909328.521617:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788909328.521634:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875807019562752:0@lo:400:kworker.0 00000100:00080000:0.0:1788909328.521644:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788909328.521731:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890508ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019563136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788909328.521747:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788909328.521758:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019563264:0@lo:400:kworker.0 00000100:00100000:1.0:1788909328.521766:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909328.521791:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909328.521793:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788909328.521801:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019562624:0@lo:400:kworker.0 00000100:00100000:1.0:1788909328.521837:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909328.521870:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905342a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019563008:0@lo:400:kworker.0 00000100:00100000:1.0:1788909328.521895:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909328.521933:0:15157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019563136 00000100:00100000:1.0:1788909328.521937:0:15157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019563136 00000100:00100000:2.0:1788909328.521940:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019562624 00000100:00100000:2.0:1788909328.521946:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019562624 00000100:00100000:1.0:1788909328.521973:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788909328.521982:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788909328.521984:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905342a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019563136:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788909328.521994:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3285:x1875807019562624:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788909328.522013:0:15157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788909328.522074:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019563264 00000100:00100000:0.0:1788909328.522079:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019563264 00000100:00100000:0.0:1788909328.522157:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019563008 00000100:00100000:0.0:1788909328.522161:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019563008 00000100:00100000:0.0:1788909328.522180:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788909328.522186:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019563264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909328.522571:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788909328.522582:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019563008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909328.523937:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905342a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875807019563136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1945us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909328.523952:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788909328.524981:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875807019563264:12345-0@lo:400:kworker.0 Request processed in 2786us (3181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909328.524997:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788909328.525047:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788909328.526338:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019562624:0@lo:400:kworker.0 00000100:00100000:1.0:1788909328.526391:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890508ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875807019563136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788909328.526511:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875807019563264:0@lo:400:kworker.0 00000100:00100000:3.0:1788909328.533675:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875807019563008:12345-0@lo:400:kworker.0 Request processed in 11083us (11766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909328.533693:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788909328.533857:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3285:x1875807019562624:12345-0@lo:400:kworker.0 Request processed in 11862us (12015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909328.533868:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788909328.534642:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905342a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875807019563008:0@lo:400:kworker.0 00010000:00010000:3.0:1788909328.972000:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788909329.415171:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788909329.637985:0:16580:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe46571810 20000000:00000080:2.0:1788909329.638006:0:16580:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89053d599000 uarg=0000000000000000 20000000:01000000:2.0:1788909329.638050:0:16580:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788909329.638056:0:16580:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788909329.638061:0:16580:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788909329.639903:0:16581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788909329.640098:0:16580:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788909329.646932:0:16580:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788909329.646974:0:16580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.646997:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d66fa expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647005:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d6747 expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647013:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d67b7 expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647024:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44961 expref: 12 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647031:0:16580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449c3 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647037:0:16580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647088:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449c3 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647414:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449c3 expref: 12 pid: 14460 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909329.647445:0:16580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d431880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019563392:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909329.647585:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44961 expref: 12 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647611:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44961 expref: 12 pid: 14463 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909329.647621:0:16580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d432d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019563520:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909329.647656:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d67b7 expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647664:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d67b7 expref: 18 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909329.647674:0:16580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d433b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019563648:0@lo:104: 00000100:00100000:2.0:1788909329.647714:0:16580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788909329.647758:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d6747 expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.647767:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d6747 expref: 18 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909329.647776:0:16580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d433100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019563776:0@lo:104: 00000100:00100000:2.0:1788909329.647796:0:16580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909329.647903:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019563648 00000100:00100000:2.0:1788909329.647912:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019563648 00000100:00100000:2.0:1788909329.647958:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019563776 00000100:00100000:2.0:1788909329.647961:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019563776 00000100:00100000:2.0:1788909329.647982:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788909329.647991:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+4:16580:x1875807019563648:12345-0@lo:104: 00010000:00010000:2.0:1788909329.648004:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648058:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788909329.648065:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+4:16580:x1875807019563648:12345-0@lo:104: Request processed in 75us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909329.648072:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788909329.648090:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788909329.648096:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:16580:x1875807019563776:12345-0@lo:104: 00010000:00010000:2.0:1788909329.648104:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648178:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788909329.648184:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:16580:x1875807019563776:12345-0@lo:104: Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909329.648190:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788909329.648207:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788909329.648213:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648220:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517800 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909329.648225:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648235:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909329.648243:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909329.648249:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788909329.648425:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648493:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909329.648516:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648522:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89053c517800/0x733cfdd8721d67b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d67be expref: -99 pid: 15867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648534:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788909329.648537:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648543:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769200 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:2.0:1788909329.648546:0:14457:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648552:0:14457:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788909329.648558:0:14457:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788909329.648563:0:14457:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788909329.648582:0:14457:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648587:0:14457:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788909329.648598:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.648614:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89053c769200/0x733cfdd8721d6747 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d674e expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.648704:0:16580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x733cfdd8721d66fa expref: 18 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.648713:0:16580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x733cfdd8721d66fa expref: 18 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909329.648722:0:16580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019564160:0@lo:104: 00000100:00100000:3.0:1788909329.648758:0:16580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909329.648779:0:16580:0:(client.c:2715:ptlrpc_set_wait()) set ffff890510b753c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909329.648797:0:16580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d433b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019563648:0@lo:104: 00000100:00100000:3.0:1788909329.648805:0:16580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d433100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019563776:0@lo:104: 00000100:00100000:3.0:1788909329.648865:0:14451:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788909329.648875:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019564160 00000100:00100000:3.0:1788909329.648879:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019564160 00000100:00100000:3.0:1788909329.648904:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788909329.648910:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053346dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:16580:x1875807019564160:12345-0@lo:104: 00010000:00010000:3.0:1788909329.648918:0:14451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.648954:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788909329.648959:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053346dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af89eede-3fcd-45ad-88b4-973cc21df0c9+3:16580:x1875807019564160:12345-0@lo:104: Request processed in 50us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909329.648965:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788909329.649006:0:14456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788909329.649011:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.649018:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768e00 already unused, calling callback (ffffffffc1b52c20) 10000000:00010000:3.0:1788909329.649021:0:14456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.649029:0:14456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788909329.649035:0:14456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909329.649052:0:14456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788909329.649070:0:14456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.649077:0:14456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788909329.649084:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.649091:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff89053c768e00/0x733cfdd8721d66fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x733cfdd8721d6701 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.649102:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909329.649103:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909329.649105:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909329.649160:0:16580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019564160:0@lo:104: 00010000:00010000:1.0:1788909329.649420:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909329.649428:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788909329.649450:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019563904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909329.649480:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909329.649513:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019564032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909329.649536:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909329.649553:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788909329.649558:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019564288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909329.649579:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909329.649605:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019563904 00000100:00100000:1.0:1788909329.649609:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019563904 00010000:00010000:1.0:1788909329.649630:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d67b7 expref: 19 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909329.649644:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019564032 00000100:00100000:1.0:1788909329.649647:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019564032 00010000:00010000:1.0:1788909329.649657:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d6747 expref: 20 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909329.649667:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019564288 00000100:00100000:1.0:1788909329.649669:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019564288 00010000:00010000:1.0:1788909329.649679:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d66fa expref: 21 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909329.649704:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788909329.649712:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+21:3283:x1875807019563904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788909329.649723:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909329.649729:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d67b7 expref: 21 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909329.649738:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d67b7 expref: 21 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909329.649752:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89053c769800/0x733cfdd8721d67be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d67b7 expref: 21 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909329.649765:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909329.649793:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+20:3283:x1875807019563904:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909329.649799:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788909329.649820:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788909329.649827:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3285:x1875807019564032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788909329.649835:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909329.649839:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d6747 expref: 19 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909329.649847:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d6747 expref: 19 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909329.649856:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8905180a6600/0x733cfdd8721d674e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d6747 expref: 19 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909329.649875:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909329.649903:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:3285:x1875807019564032:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909329.649909:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788909329.649922:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788909329.649928:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510378850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:3285:x1875807019564288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788909329.649936:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909329.649940:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x733cfdd8721d66fa expref: 17 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909329.649948:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x733cfdd8721d66fa expref: 17 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909329.649957:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89052dc10400/0x733cfdd8721d6701 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x733cfdd8721d66fa expref: 17 pid: 14462 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909329.649966:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909329.649986:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510378850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:3285:x1875807019564288:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909329.649992:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788909329.650045:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019563904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909329.650068:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019564288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788909329.650076:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af89eede-3fcd-45ad-88b4-973cc21df0c9:3285:1875807019564032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788909329.650729:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909329.650731:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788909329.650734:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909329.660785:0:16580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d431880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019563392:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788909329.660801:0:16580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d432d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16580:1875807019563520:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909329.660852:0:16580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909329.661348:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909329.661442:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004898688 00000100:00100000:1.0:1788909329.661451:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004898688 00010000:00010000:1.0:1788909329.661503:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449c3 expref: 13 pid: 14460 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909329.661515:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909329.664853:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004898816 00000100:00100000:1.0:1788909329.664871:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004898816 00000100:00100000:3.0:1788909329.664930:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00010000:00010000:1.0:1788909329.664934:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44961 expref: 14 pid: 14463 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909329.664963:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+14:2349:x1875807004898688:12345-192.168.204.54@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788909329.664969:0:14455:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788909329.664982:0:14455:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788909329.664993:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909329.665009:0:14454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449c3 expref: 14 pid: 14460 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665029:0:14454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449c3 expref: 14 pid: 14460 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665081:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890401a9a400/0x733cfdd8721d69e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449c3 expref: 14 pid: 14460 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665160:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909329.665277:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:2349:x1875807004898688:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 331us (3931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909329.665285:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788909329.665327:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788909329.665501:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:2350:x1875807004898816:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909329.665512:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909329.665519:0:14454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44961 expref: 12 pid: 14463 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665530:0:14454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44961 expref: 12 pid: 14463 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665542:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8905180a7000/0x733cfdd8721d69a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44961 expref: 12 pid: 14463 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665558:0:14454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665569:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665590:0:14454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665615:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665623:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665631:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665638:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9ae00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909329.665644:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665660:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665687:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909329.665701:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909329.665734:0:16580:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.665760:0:16580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909329.665769:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890401a9ae00/0x733cfdd8721d6a0a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909329.666399:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:2350:x1875807004898816:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 897us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909329.666411:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00010000:00010000:3.0:1788909329.989747:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788909331.013373:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788909331.290449:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909331.290524:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004898944 00000100:00100000:0.0:1788909331.290535:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004898944 00000100:00100000:0.0:1788909331.290596:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:0.0:1788909331.290606:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+11:13777:x1875807004898944:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788909331.290622:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909331.290640:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89053c516600/0x733cfdd8721d6a11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a449f4 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909331.290667:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89053c516600/0x733cfdd8721d6a11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449f4 expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909331.290678:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89053c516600/0x733cfdd8721d6a11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449f4 expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909331.290687:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516600, rc 0) 00000100:00100000:0.0:1788909331.290735:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13777:x1875807004898944:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 131us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909331.290742:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 105 00000100:00100000:1.0:1788909331.295896:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909331.296008:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004899072 00000100:00100000:2.0:1788909331.296018:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004899072 00000100:00100000:2.0:1788909331.296080:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:2.0:1788909331.296101:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13777:x1875807004899072:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909331.297651:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13777:x1875807004899072:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 1555us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909331.297664:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 106 00000100:00100000:2.0:1788909331.301014:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909331.301282:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004899200 00000100:00100000:1.0:1788909331.301294:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004899200 00000100:00100000:1.0:1788909331.301348:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:1.0:1788909331.301359:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13777:x1875807004899200:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788909331.301590:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13777:x1875807004899200:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 230us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909331.301600:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 107 00000100:00100000:1.0:1788909331.323734:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909331.324155:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004899328 00000100:00100000:3.0:1788909331.324165:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004899328 00000100:00100000:3.0:1788909331.324220:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:3.0:1788909331.324230:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+12:13777:x1875807004899328:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909331.324249:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909331.324270:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a7000/0x733cfdd8721d6a18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb281451763a449fb expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.324329:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a7000/0x733cfdd8721d6a18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449fb expref: 13 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.324345:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a7000/0x733cfdd8721d6a18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449fb expref: 13 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.324356:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7000, rc 0) 00000100:00100000:3.0:1788909331.324551:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13777:x1875807004899328:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 321us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909331.324559:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 108 00000100:00100000:3.0:1788909331.328780:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909331.328930:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004899456 00000100:00100000:2.0:1788909331.328944:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004899456 00000100:00100000:2.0:1788909331.329019:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:2.0:1788909331.329033:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13777:x1875807004899456:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909331.329445:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13777:x1875807004899456:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 413us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909331.329454:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 109 00000100:00100000:1.0:1788909331.333676:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909331.333840:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004899584 00000100:00100000:3.0:1788909331.333850:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004899584 00000100:00100000:3.0:1788909331.333911:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 110 00000100:00100000:3.0:1788909331.333924:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13777:x1875807004899584:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.334374:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:13777:x1875807004899584:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 451us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909331.334384:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 110 10000000:01000000:3.0:1788909331.461289:0:14465:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788909331.461298:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8905379d4000 from 10 10000000:01000000:3.0:1788909331.461304:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788909331.461359:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6000/0x733cfdd8721d6a1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.461372:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8905180a6000/0x733cfdd8721d6a1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.461400:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8905180a6000/0x733cfdd8721d6a1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909331.461430:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.461512:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909331.461562:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788909331.461595:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019564416 00000100:00100000:3.0:1788909331.461602:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019564416 00000100:00100000:3.0:1788909331.461647:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788909331.461656:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+16:14465:x1875807019564416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909331.461670:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909331.461683:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a7600/0x733cfdd8721d6a26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d6a1f expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.461710:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a7600/0x733cfdd8721d6a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d6a1f expref: 17 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.461721:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a7600/0x733cfdd8721d6a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d6a1f expref: 17 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.461731:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7600, rc 0) 00000100:00100000:3.0:1788909331.461770:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:14465:x1875807019564416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909331.461777:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788909331.461840:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909331.461855:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8905180a6000/0x733cfdd8721d6a1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6a26 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.461871:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8905180a6000/0x733cfdd8721d6a1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d6a26 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909331.461926:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.461950:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909331.461963:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff89053c53d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788909331.461974:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019564544 00000100:00100000:3.0:1788909331.461977:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019564544 00000100:00100000:3.0:1788909331.461999:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788909331.462004:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:14465:x1875807019564544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.462281:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:14465:x1875807019564544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909331.462288:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788909331.462319:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.462346:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.462383:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909331.462396:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905274af9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909331.462409:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019564672 00000100:00100000:3.0:1788909331.462413:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019564672 00000100:00100000:3.0:1788909331.462432:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788909331.462437:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:14465:x1875807019564672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.462575:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:14465:x1875807019564672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909331.462582:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788909331.462622:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788909331.463300:0:16668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788909331.463364:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788909331.463380:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788909331.463391:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6000/0x733cfdd8721d6a1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6a26 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.463402:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8905180a6000/0x733cfdd8721d6a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6a26 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788909331.463414:0:14465:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788909331.463417:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff890537b24800 from 10 10000000:01000000:3.0:1788909331.463420:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788909331.463450:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d6a2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.463459:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d6a2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.463469:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d6a2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909331.463491:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.463536:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909331.463559:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905274af300 going to sleep for 11 seconds 00000100:00100000:3.0:1788909331.463581:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019564800 00000100:00100000:3.0:1788909331.463586:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019564800 00000100:00100000:3.0:1788909331.463617:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788909331.463624:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+17:14465:x1875807019564800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909331.463650:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909331.463666:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a6c00/0x733cfdd8721d6a34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d6a2d expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.463692:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a6c00/0x733cfdd8721d6a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d6a2d expref: 18 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.463703:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a6c00/0x733cfdd8721d6a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d6a2d expref: 18 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.463712:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6c00, rc 0) 00000100:00100000:3.0:1788909331.463746:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:14465:x1875807019564800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909331.463752:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788909331.463796:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909331.463810:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d6a2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6a34 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.463819:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d6a2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d6a34 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909331.463863:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.463887:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909331.463900:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890510b75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788909331.463914:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019564928 00000100:00100000:3.0:1788909331.463917:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019564928 00000100:00100000:3.0:1788909331.463935:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788909331.463941:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:14465:x1875807019564928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.464511:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:14465:x1875807019564928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 568us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909331.464519:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788909331.464670:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905344db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019564928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909331.464705:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d430700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019565056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909331.464747:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909331.464779:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506130f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788909331.464821:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019565056 00000100:00100000:3.0:1788909331.464826:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019565056 00000100:00100000:3.0:1788909331.464890:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788909331.464900:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:14465:x1875807019565056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788909331.465068:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:14465:x1875807019565056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909331.465074:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788909331.465182:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d430700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019565056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788909331.466413:0:16669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788909331.466616:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788909331.466639:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788909331.466651:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d6a2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6a34 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909331.466662:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8905180a6600/0x733cfdd8721d6a2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6a34 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788909331.466687:0:14465:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788909331.466689:0:14465:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89053c610000 from 10 10000000:01000000:1.0:1788909331.466692:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788909331.466731:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c769a00/0x733cfdd8721d6a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909331.466738:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff89053c769a00/0x733cfdd8721d6a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909331.466748:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff89053c769a00/0x733cfdd8721d6a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909331.466770:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019565184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788909331.466829:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909331.466904:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890507c943c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909331.466961:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019565184 00000100:00100000:3.0:1788909331.466969:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019565184 00000100:00100000:3.0:1788909331.467059:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788909331.467069:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+18:14465:x1875807019565184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788909331.467082:0:14463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909331.467136:0:14463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8905180a7800/0x733cfdd8721d6a42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x733cfdd8721d6a3b expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.467161:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8905180a7800/0x733cfdd8721d6a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x733cfdd8721d6a3b expref: 19 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.467169:0:14463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8905180a7800/0x733cfdd8721d6a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x733cfdd8721d6a3b expref: 19 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909331.467177:0:14463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a7800, rc 0) 00000100:00100000:3.0:1788909331.467210:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:14465:x1875807019565184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909331.467229:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788909331.467306:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019565184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788909331.467318:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff89053c769a00/0x733cfdd8721d6a3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6a42 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909331.467326:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff89053c769a00/0x733cfdd8721d6a3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x733cfdd8721d6a42 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909331.467388:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019565312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788909331.467415:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909331.467625:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890507c943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909331.467714:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019565312 00000100:00100000:2.0:1788909331.467720:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019565312 00000100:00100000:2.0:1788909331.467743:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788909331.467751:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:14465:x1875807019565312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788909331.468073:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:14465:x1875807019565312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909331.468080:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788909331.470052:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019565312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788909331.470159:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019565440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788909331.470226:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909331.470262:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff890507c943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788909331.472230:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019565440 00000100:00100000:2.0:1788909331.472245:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019565440 00000100:00100000:2.0:1788909331.472302:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788909331.472311:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:14465:x1875807019565440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788909331.472627:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:14465:x1875807019565440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 316us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909331.472635:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788909331.472705:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af89eede-3fcd-45ad-88b4-973cc21df0c9:14465:1875807019565440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788909331.473632:0:16671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788909331.473778:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788909331.473811:0:14465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788909331.473824:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff89053c769a00/0x733cfdd8721d6a3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6a42 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909331.473838:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff89053c769a00/0x733cfdd8721d6a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x733cfdd8721d6a42 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.038304:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788909332.832271:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909332.832948:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004899712 00000100:00100000:0.0:1788909332.832961:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004899712 00000100:00100000:0.0:1788909332.833098:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1788909332.833160:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:14434:x1875807004899712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909332.833193:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909332.833223:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a02 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.833294:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.833309:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.833346:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.833373:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.833384:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.833393:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834102:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6a5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788909332.834148:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788909332.834151:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6a5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834158:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6a5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909332.834253:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788909332.834257:0:14469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909332.834350:0:14469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6a5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834363:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834369:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834387:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834393:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909332.834398:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834406:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834420:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693bb00) 00010000:00010000:0.0:1788909332.834424:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909332.834428:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834435:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834453:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834458:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834464:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834468:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909332.834471:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834493:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834501:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff890513293100) 00010000:00010000:0.0:1788909332.834503:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909332.834506:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834511:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834547:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a02 expref: 8 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834561:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517400/0x733cfdd8721d6a5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a02 expref: 7 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.834569:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890513293c00) 00010000:00010000:0.0:1788909332.834572:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788909332.834574:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517400, rc 0) 00000100:00100000:0.0:1788909332.834660:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:14434:x1875807004899712:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 1549us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909332.834669:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1788909332.841819:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909332.841980:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004899968 00000100:00100000:2.0:1788909332.841994:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004899968 00000100:00100000:2.0:1788909332.842084:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788909332.842101:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:14434:x1875807004899968:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788909332.842150:0:15177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909332.842172:0:15177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6a65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a09 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.842255:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.842272:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.842283:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.842344:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.842352:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.842359:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845513:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9be00/0x733cfdd8721d6a7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845536:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9be00/0x733cfdd8721d6a7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845556:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9be00/0x733cfdd8721d6a7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909332.845569:0:15177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788909332.845856:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845865:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845873:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845879:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9b000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909332.845884:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845891:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845904:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890513293c00) 00010000:00010000:2.0:1788909332.845908:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909332.845915:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845925:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6a6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845949:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845958:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845980:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.845987:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9a000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909332.845992:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.846001:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.846016:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89050693b000) 00010000:00010000:2.0:1788909332.846020:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909332.846024:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.846033:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6a73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.846544:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6a65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a09 expref: 10 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.846560:0:15177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9be00/0x733cfdd8721d6a7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a09 expref: 9 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.846569:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89050693b500) 00010000:00010000:2.0:1788909332.846573:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909332.846576:0:15177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9be00, rc 0) 00000100:00100000:2.0:1788909332.846705:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:14434:x1875807004899968:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 4605us (4891us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788909332.846740:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1788909332.865827:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909332.867514:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004900096 00000100:00100000:0.0:1788909332.867530:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004900096 00000100:00100000:0.0:1788909332.867616:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:0.0:1788909332.867628:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:14434:x1875807004900096:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788909332.867788:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:14434:x1875807004900096:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 162us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909332.867797:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788909332.893872:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909332.894014:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004900224 00000100:00100000:0.0:1788909332.894031:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004900224 00000100:00100000:0.0:1788909332.894211:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1788909332.894222:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:14440:x1875807004900224:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909332.894245:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909332.894267:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a10 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894334:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894354:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894365:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894381:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894388:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894394:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894698:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894712:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894719:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894725:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909332.894730:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894737:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894750:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693bb00) 00010000:00010000:0.0:1788909332.894753:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909332.894757:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894763:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6a8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894777:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894783:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894789:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894793:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909332.894802:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894808:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894816:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890513293100) 00010000:00010000:0.0:1788909332.894818:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909332.894821:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894826:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6a96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894864:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a10 expref: 10 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894874:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693bb00) 00010000:00010000:0.0:1788909332.894876:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909332.894885:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a10 expref: 10 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.894896:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516200, rc 0) 00000100:00100000:0.0:1788909332.894991:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:14440:x1875807004900224:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 771us (1138us total) trans 0 rc 301/301 00000100:00100000:0.0:1788909332.895003:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788909332.900100:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909332.900320:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004900352 00000100:00100000:2.0:1788909332.900332:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004900352 00000100:00100000:2.0:1788909332.900395:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788909332.900407:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:14440:x1875807004900352:12345-192.168.204.54@tcp:700:lfs.0 00000100:00100000:2.0:1788909332.900510:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:14440:x1875807004900352:12345-192.168.204.54@tcp:700:lfs.0 Request processed in 106us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909332.900519:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788909332.905567:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909332.905668:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004900608 00000100:00100000:0.0:1788909332.905683:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004900608 00000100:00100000:0.0:1788909332.905745:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788909332.905756:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:14440:x1875807004900608:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:0.0:1788909332.905830:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788909332.905856:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d69cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a4498b expref: 9 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.905877:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693bb00) 00010000:00010000:0.0:1788909332.905882:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788909332.906246:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.906262:0:14468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a449ed expref: 5 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.906271:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.906302:0:14468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449ed expref: 5 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.906317:0:14468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449ed expref: 5 pid: 14467 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909332.906332:0:14468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890508ff9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14468:1875807019565568:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909332.906450:0:14468:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a58480 going to sleep for 11 seconds 00000100:00100000:0.0:1788909332.913195:0:14468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890508ff9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14468:1875807019565568:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909332.913232:0:14468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909332.916270:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909332.916634:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004900736 00000100:00100000:2.0:1788909332.916645:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004900736 00010000:00010000:2.0:1788909332.916714:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449ed expref: 6 pid: 14467 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909332.916764:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788909332.916775:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00072612-ab86-4466-947e-4aecf4863d3a+6:2350:x1875807004900736:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909332.916789:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909332.916797:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449ed expref: 6 pid: 14467 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.916811:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449ed expref: 6 pid: 14467 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.916834:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768a00/0x733cfdd8721d6a03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a449ed expref: 6 pid: 14467 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.916853:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693bb00) 00010000:00010000:2.0:1788909332.916873:0:14453:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.916883:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.916892:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909332.916924:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909332.916975:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00072612-ab86-4466-947e-4aecf4863d3a+5:2350:x1875807004900736:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 202us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909332.916983:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00080000:0.0:1788909332.917170:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788909332.919081:0:14468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.919099:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.919162:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.919179:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.919193:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909332.922512:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788909332.922537:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.922549:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.922556:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.922562:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909332.922567:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.922576:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.922594:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693bb00) 00010000:00010000:0.0:1788909332.922608:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909332.922614:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.922622:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6a9d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788909332.922654:0:14468:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000686868c4 reply state 00000000a83b3e84 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909332.922665:0:14468:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788909332.922939:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+10:14440:x1875807004900608:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 17180us (17378us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788909332.922949:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:0.0:1788909332.925499:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.925516:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.925525:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.925531:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909332.925536:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.925543:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.925561:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890513293100) 00010000:00010000:0.0:1788909332.925564:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909332.925585:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909332.925592:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6aa4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909332.999704:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909332.999822:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004900864 00000100:00100000:2.0:1788909332.999837:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004900864 00000100:00100000:2.0:1788909332.999958:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788909332.999968:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:14448:x1875807004900864:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:2.0:1788909332.999991:0:15177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909333.000013:0:15177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6aab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a17 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.000091:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6ab2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.000103:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.000157:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909333.000218:0:15177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788909333.000233:0:15177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909333.000278:0:15177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.000305:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6aab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a17 expref: 11 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.000323:0:15177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a000/0x733cfdd8721d6ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a17 expref: 10 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.000332:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693b000) 00010000:00010000:2.0:1788909333.000335:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788909333.000338:0:15177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9a000, rc 0) 00000100:00100000:2.0:1788909333.000399:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+10:14448:x1875807004900864:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 433us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.000405:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788909333.019327:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909333.019454:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004900992 00000100:00100000:0.0:1788909333.019465:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004900992 00000100:00100000:0.0:1788909333.019589:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788909333.019612:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00072612-ab86-4466-947e-4aecf4863d3a+5:14449:x1875807004900992:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909333.019642:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909333.019670:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6ab9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a1e expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.020007:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6ac0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.020023:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.020036:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909333.020152:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788909333.020156:0:14469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909333.020185:0:14469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.020213:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516e00/0x733cfdd8721d6ab9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a1e expref: 7 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.020236:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516200/0x733cfdd8721d6ac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a1e expref: 6 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.020260:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693b000) 00010000:00010000:0.0:1788909333.020263:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788909333.020266:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516200, rc 0) 00000100:00100000:0.0:1788909333.020330:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00072612-ab86-4466-947e-4aecf4863d3a+6:14449:x1875807004900992:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 731us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909333.020338:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:3.0:1788909333.023540:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909333.023722:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004901120 00000100:00100000:0.0:1788909333.023736:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004901120 00000100:00100000:0.0:1788909333.023857:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1788909333.023869:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00072612-ab86-4466-947e-4aecf4863d3a+6:14449:x1875807004901120:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909333.023890:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909333.023911:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6ac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a25 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.023978:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.023994:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024007:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024024:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024031:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024071:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024219:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6adc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024228:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6adc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024236:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6adc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909333.024296:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788909333.024300:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909333.024335:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6adc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024352:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024358:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024365:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024371:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909333.024377:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024384:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024405:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693b000) 00010000:00010000:0.0:1788909333.024409:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909333.024414:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024421:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6ace lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024441:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024447:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024453:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024459:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909333.024462:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024468:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024476:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890513293100) 00010000:00010000:0.0:1788909333.024478:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909333.024481:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024487:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6ad5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024535:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6ac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a25 expref: 8 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024550:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6adc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a25 expref: 7 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.024557:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890513293500) 00010000:00010000:0.0:1788909333.024559:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788909333.024562:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517800, rc 0) 00000100:00100000:0.0:1788909333.024643:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00072612-ab86-4466-947e-4aecf4863d3a+7:14449:x1875807004901120:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 777us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909333.024652:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1788909333.029728:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.030751:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004901376 00000100:00100000:2.0:1788909333.030764:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004901376 00000100:00100000:2.0:1788909333.030921:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1788909333.030934:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00072612-ab86-4466-947e-4aecf4863d3a+7:14449:x1875807004901376:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909333.030959:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909333.030984:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6ae3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a2c expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909333.031158:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788909333.031292:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6ae3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a2c expref: 9 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.031307:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693b000) 00010000:00010000:2.0:1788909333.031322:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909333.031328:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6ae3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a2c expref: 9 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.031343:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9ac00, rc 0) 00000100:00100000:2.0:1788909333.031421:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00072612-ab86-4466-947e-4aecf4863d3a+8:14449:x1875807004901376:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 489us (1700us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788909333.031429:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1788909333.036704:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.036874:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004901632 00000100:00100000:2.0:1788909333.036888:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004901632 00000100:00100000:2.0:1788909333.036957:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:2.0:1788909333.036967:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00072612-ab86-4466-947e-4aecf4863d3a+8:14449:x1875807004901632:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1788909333.037026:0:15177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909333.037053:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517800/0x733cfdd8721d6adc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a25 expref: 8 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.037089:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890513293500) 00010000:00010000:2.0:1788909333.037101:0:15177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909333.041021:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.041048:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.041075:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909333.041386:0:15177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c479963f reply state 000000008ff8468b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909333.041414:0:15177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788909333.041431:0:15177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788909333.041601:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00072612-ab86-4466-947e-4aecf4863d3a+9:14449:x1875807004901632:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 4631us (4902us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788909333.041611:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1788909333.046381:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00010000:00010000:0.0:1788909333.046489:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.046502:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.046510:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.046516:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9b000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909333.046520:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.046527:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.046547:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89050693b400) 00000100:00100000:1.0:1788909333.046560:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004901888 00010000:00010000:0.0:1788909333.046562:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788909333.046570:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909333.046573:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004901888 00010000:00010000:0.0:1788909333.046579:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6af1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909333.046690:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:1.0:1788909333.046701:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00072612-ab86-4466-947e-4aecf4863d3a+8:14449:x1875807004901888:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788909333.046965:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00072612-ab86-4466-947e-4aecf4863d3a+9:14449:x1875807004901888:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 266us (592us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788909333.046973:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788909333.051272:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909333.051376:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004902144 00000100:00100000:0.0:1788909333.051388:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004902144 00000100:00100000:0.0:1788909333.052578:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1788909333.052604:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00072612-ab86-4466-947e-4aecf4863d3a+9:14449:x1875807004902144:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909333.052649:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909333.052671:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6af8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a33 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.052762:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.052776:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.052787:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.052802:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.052809:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.052816:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909333.052975:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788909333.053093:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053101:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053129:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053136:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909333.053141:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053148:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053161:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693b000) 00010000:00010000:0.0:1788909333.053165:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909333.053170:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053176:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6aff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053189:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053194:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053211:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053216:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c516c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909333.053218:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053224:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053232:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890513293100) 00010000:00010000:0.0:1788909333.053235:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909333.053238:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053244:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053302:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6af8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a33 expref: 11 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053314:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693b000) 00010000:00010000:0.0:1788909333.053317:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788909333.053320:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6af8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a33 expref: 11 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.053330:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517a00, rc 0) 00000100:00100000:0.0:1788909333.053415:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00072612-ab86-4466-947e-4aecf4863d3a+10:14449:x1875807004902144:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 823us (2155us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788909333.053433:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788909333.059403:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909333.059469:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004902272 00000100:00100000:0.0:1788909333.059483:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004902272 00000100:00100000:0.0:1788909333.059573:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1788909333.059584:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00072612-ab86-4466-947e-4aecf4863d3a+10:14449:x1875807004902272:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909333.059613:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909333.059638:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6b14 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a3a expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.059750:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.059765:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.059778:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909333.059835:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788909333.059838:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788909333.059867:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.059893:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6b14 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a3a expref: 12 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.059909:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a3a expref: 11 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.059937:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890513293100) 00010000:00010000:0.0:1788909333.059940:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788909333.059943:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516c00, rc 0) 00000100:00100000:0.0:1788909333.060017:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00072612-ab86-4466-947e-4aecf4863d3a+11:14449:x1875807004902272:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 435us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909333.060024:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00010000:00010000:3.0:1788909333.061460:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788909333.066449:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.066630:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004902400 00000100:00100000:2.0:1788909333.066646:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004902400 00000100:00100000:2.0:1788909333.066710:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:2.0:1788909333.066721:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00072612-ab86-4466-947e-4aecf4863d3a+11:14449:x1875807004902400:12345-192.168.204.54@tcp:37:lfs.0 00000100:00100000:1.0:1788909333.073457:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00072612-ab86-4466-947e-4aecf4863d3a+11:14449:x1875807004902400:12345-192.168.204.54@tcp:37:lfs.0 Request processed in 6723us (7003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909333.073474:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788909333.082398:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909333.082495:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004902656 00000100:00100000:3.0:1788909333.082512:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004902656 00000100:00100000:3.0:1788909333.082874:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788909333.082887:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510338050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00072612-ab86-4466-947e-4aecf4863d3a+11:14449:x1875807004902656:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788909333.083239:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510338050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00072612-ab86-4466-947e-4aecf4863d3a+12:14449:x1875807004902656:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 355us (851us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788909333.083247:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:3.0:1788909333.136885:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.136955:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004902784 00000100:00100000:2.0:1788909333.136967:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004902784 00000100:00100000:2.0:1788909333.137038:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788909333.137049:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+10:14455:x1875807004902784:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909333.137080:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909333.137141:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a41 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137216:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137232:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137244:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137258:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137281:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137288:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137409:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a600/0x733cfdd8721d6b37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137417:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a600/0x733cfdd8721d6b37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137424:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a600/0x733cfdd8721d6b37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909333.137456:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788909333.137459:0:14468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909333.137508:0:14468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a600/0x733cfdd8721d6b37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137519:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137525:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137532:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137538:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9aa00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909333.137541:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137555:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137566:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693b000) 00010000:00010000:2.0:1788909333.137569:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909333.137574:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137579:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137590:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137595:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137600:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137605:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9a200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909333.137607:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137612:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137618:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89050693b700) 00010000:00010000:2.0:1788909333.137621:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909333.137623:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137638:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137671:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a41 expref: 12 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137760:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a600/0x733cfdd8721d6b37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a41 expref: 11 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.137770:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890513293100) 00010000:00010000:2.0:1788909333.137772:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788909333.137775:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9a600, rc 0) 00000100:00100000:2.0:1788909333.137925:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+11:14455:x1875807004902784:12345-192.168.204.54@tcp:101:bash.0 Request processed in 877us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.137933:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1788909333.142469:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.142562:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004903040 00000100:00100000:2.0:1788909333.142572:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004903040 00000100:00100000:2.0:1788909333.142661:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:2.0:1788909333.142672:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+11:14455:x1875807004903040:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909333.142701:0:15177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909333.142728:0:15177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6b3e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a48 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.142883:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.142899:0:15177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a3a expref: 11 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.142924:0:15177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.142959:0:15177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a3a expref: 11 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.142971:0:15177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a3a expref: 11 pid: 14467 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909333.142984:0:15177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d433800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15177:1875807019565696:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909333.143171:0:15177:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905061300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909333.155203:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909333.155276:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004903168 00000100:00100000:1.0:1788909333.155315:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004903168 00010000:00010000:1.0:1788909333.155382:0:14454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a3a expref: 12 pid: 14467 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909333.155440:0:15177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d433800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15177:1875807019565696:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909333.155446:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:1.0:1788909333.155462:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00072612-ab86-4466-947e-4aecf4863d3a+12:2350:x1875807004903168:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909333.155482:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909333.155490:0:14454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a3a expref: 12 pid: 14467 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.155504:0:14454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a3a expref: 12 pid: 14467 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.155533:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516c00/0x733cfdd8721d6b1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a3a expref: 12 pid: 14467 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.155559:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890513293100) 00010000:00010000:1.0:1788909333.155565:0:14454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.155577:0:14454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.155585:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.155609:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909333.155617:0:15177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.155631:0:15177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.155638:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.155670:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.155682:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.155691:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909333.155703:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00072612-ab86-4466-947e-4aecf4863d3a+11:2350:x1875807004903168:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 242us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909333.155725:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00010000:00010000:2.0:1788909333.158516:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.158540:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.158553:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909333.158565:0:15177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788909333.158591:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.158599:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.158606:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.158612:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9ac00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909333.158617:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.158625:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.158637:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890513293100) 00010000:00010000:2.0:1788909333.158640:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909333.158644:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.158738:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b45 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788909333.160198:0:15177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a148b58 reply state 00000000544ee1e6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909333.160212:0:15177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788909333.160273:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6b3e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a48 expref: 14 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.160290:0:15177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a48 expref: 13 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.160315:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:2.0:1788909333.160318:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788909333.160322:0:15177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9a200, rc 0) 00000100:00100000:2.0:1788909333.160474:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+14:14455:x1875807004903040:12345-192.168.204.54@tcp:101:bash.0 Request processed in 17802us (18014us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788909333.160485:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00010000:00010000:1.0:1788909333.167029:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.167048:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.167066:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.167073:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9bc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909333.167078:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.167087:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.167105:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89050693b700) 00010000:00010000:1.0:1788909333.167127:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788909333.167135:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.167142:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9bc00/0x733cfdd8721d6b4c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909333.174483:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.175561:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004903296 00000100:00100000:2.0:1788909333.175583:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004903296 00000100:00100000:2.0:1788909333.175689:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:2.0:1788909333.175701:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+13:14455:x1875807004903296:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788909333.175735:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909333.175768:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6b61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a4f expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.175878:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.175895:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.175909:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909333.175974:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788909333.175979:0:14468:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909333.176000:0:14468:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.176010:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.176033:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6b61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a4f expref: 15 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.176050:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a4f expref: 14 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.176069:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:2.0:1788909333.176072:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909333.176074:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9ac00, rc 0) 00000100:00100000:2.0:1788909333.176196:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+14:14455:x1875807004903296:12345-192.168.204.54@tcp:101:bash.0 Request processed in 498us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.176203:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1788909333.185948:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909333.186072:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004903552 00000100:00100000:1.0:1788909333.186087:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004903552 00000100:00100000:1.0:1788909333.186187:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788909333.186198:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+14:14455:x1875807004903552:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:1.0:1788909333.186668:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+15:14455:x1875807004903552:12345-192.168.204.54@tcp:35:bash.0 Request processed in 470us (731us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788909333.186694:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:3.0:1788909333.262737:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909333.262971:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004903808 00000100:00100000:0.0:1788909333.262982:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004903808 00000100:00100000:0.0:1788909333.263144:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788909333.263156:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+15:14465:x1875807004903808:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788909333.263189:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909333.263213:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6b6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a56 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788909333.263377:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788909333.263526:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6b6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a56 expref: 17 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.263545:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89050693b000) 00010000:00010000:0.0:1788909333.263549:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788909333.263555:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c516400/0x733cfdd8721d6b6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a56 expref: 17 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.263598:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c516400, rc 0) 00000100:00100000:0.0:1788909333.263688:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+16:14465:x1875807004903808:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 533us (960us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788909333.263697:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788909333.266685:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909333.266831:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004904064 00000100:00100000:3.0:1788909333.266842:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004904064 00000100:00100000:3.0:1788909333.267015:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1788909333.267026:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+16:14465:x1875807004904064:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788909333.267617:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+17:14465:x1875807004904064:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 592us (940us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788909333.267648:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1788909333.325070:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.325287:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004904320 00000100:00100000:2.0:1788909333.325299:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004904320 00000100:00100000:2.0:1788909333.325381:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:2.0:1788909333.325393:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+17:14468:x1875807004904320:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788909333.325758:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909333.325785:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6b7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a5d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.325917:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.325933:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.325948:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909333.325961:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788909333.326169:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6b7d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a5d expref: 20 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.326192:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a5d expref: 19 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.326202:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:2.0:1788909333.326205:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788909333.326209:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9aa00, rc 0) 00000100:00100000:2.0:1788909333.326282:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+19:14468:x1875807004904320:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 891us (1241us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788909333.326311:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1788909333.335857:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.335921:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004904448 00000100:00100000:2.0:1788909333.335932:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004904448 00000100:00100000:2.0:1788909333.335998:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788909333.336007:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+19:2350:x1875807004904448:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788909333.336023:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909333.336047:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a5d expref: 19 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.336080:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:2.0:1788909333.336084:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909333.336181:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+18:2350:x1875807004904448:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 175us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.336188:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788909333.340592:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.340967:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004904576 00000100:00100000:2.0:1788909333.340978:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004904576 00000100:00100000:2.0:1788909333.341103:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1788909333.341140:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+18:14468:x1875807004904576:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:2.0:1788909333.341211:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.341229:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.341240:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.341309:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.341315:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.341321:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.341326:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9aa00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909333.341330:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.341337:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.341351:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:2.0:1788909333.341354:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788909333.341358:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.341364:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9aa00/0x733cfdd8721d6b92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909333.341539:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+18:14468:x1875807004904576:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 426us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.341547:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1788909333.344432:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909333.344539:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004904832 00000100:00100000:1.0:1788909333.344549:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004904832 00000100:00100000:1.0:1788909333.344608:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788909333.344619:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890508ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+18:14468:x1875807004904832:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788909333.346721:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890508ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+19:14468:x1875807004904832:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 1904us (2098us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788909333.346737:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000040:00080000:1.0:1788909333.509871:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788909333.593187:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909333.593232:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909333.593260:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909333.593281:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909333.593304:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909333.593341:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004905216 00000100:00100000:3.0:1788909333.593355:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004905216 00000100:00100000:2.0:1788909333.593369:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004904960 00000100:00100000:2.0:1788909333.593376:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004904960 00000100:00100000:3.0:1788909333.593438:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004905088 00000100:00100000:3.0:1788909333.593451:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004905088 00000100:00100000:3.0:1788909333.593468:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004905472 00000100:00100000:3.0:1788909333.593471:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004905472 00000100:00100000:3.0:1788909333.593483:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004905344 00000100:00100000:3.0:1788909333.593485:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004905344 00000100:00100000:3.0:1788909333.593501:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788909333.593511:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2349:x1875807004905216:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909333.593590:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2349:x1875807004905216:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 79us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909333.593598:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788909333.593616:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788909333.593622:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2349:x1875807004905088:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909333.593650:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2349:x1875807004905088:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909333.593669:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788909333.593682:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788909333.593710:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00072612-ab86-4466-947e-4aecf4863d3a+5:2349:x1875807004905472:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909333.593736:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00072612-ab86-4466-947e-4aecf4863d3a+5:2349:x1875807004905472:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909333.593753:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788909333.593766:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788909333.593772:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00072612-ab86-4466-947e-4aecf4863d3a+5:2349:x1875807004905344:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788909333.593796:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00072612-ab86-4466-947e-4aecf4863d3a+5:2349:x1875807004905344:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909333.593802:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788909333.593978:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:2.0:1788909333.593997:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053341ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:2349:x1875807004904960:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788909333.594032:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053341ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0fd5ba3-e8e3-4ea4-9600-d2ecb5419053+13:2349:x1875807004904960:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 38us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.594039:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00080000:0.0:1788909333.594423:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788909333.594429:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788909333.638612:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788909333.638648:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019566080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909333.638648:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019565824:0@lo:400:kworker.0 00000100:00100000:3.0:1788909333.638767:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909333.638767:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909333.638860:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019565824 00000100:00100000:3.0:1788909333.638870:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019565824 00000100:00100000:3.0:1788909333.638940:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788909333.638959:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890533419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3283:x1875807019565824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909333.639019:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890533419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af89eede-3fcd-45ad-88b4-973cc21df0c9+19:3283:x1875807019565824:12345-0@lo:400:kworker.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909333.639028:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788909333.639104:0:16523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019566080 00000100:00100000:3.0:1788909333.639138:0:16523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019566080 00000100:00100000:3.0:1788909333.639198:0:16523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788909333.639210:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af89eede-3fcd-45ad-88b4-973cc21df0c9:3283:1875807019565824:0@lo:400:kworker.0 00000100:00100000:3.0:1788909333.639211:0:16523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019566080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788909333.639239:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788909333.639248:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019565952:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788909333.639262:0:16523:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909333.639281:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909333.639327:0:16523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019566080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.639337:0:15156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019565952 00000100:00100000:2.0:1788909333.639342:0:15156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019565952 00000100:00100000:3.0:1788909333.639357:0:16523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788909333.639372:0:15156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788909333.639381:0:15156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019565952:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788909333.639413:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8905064d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019566080:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788909333.639509:0:15156:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788909333.639550:0:15156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875807019565952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.639557:0:15156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788909333.639585:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875807019565952:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788909333.640603:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788909333.640614:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909333.646653:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788909333.646672:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788909333.646682:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019566208:0@lo:400:kworker.0 00000100:00100000:1.0:1788909333.646685:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019566336:0@lo:400:kworker.0 00000100:00100000:3.0:1788909333.647606:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909333.647687:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019566208 00000100:00100000:3.0:1788909333.647697:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019566208 00000100:00100000:3.0:1788909333.647716:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788909333.647728:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019566464:0@lo:400:kworker.0 00000100:00100000:3.0:1788909333.647928:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788909333.648378:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019566464 00000100:00100000:2.0:1788909333.648383:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019566464 00000100:00080000:2.0:1788909333.648407:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909333.648470:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788909333.648479:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019566208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788909333.648519:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788909333.648532:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019566464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788909333.648535:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875807019566208:12345-0@lo:400:kworker.0 Request processed in 56us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909333.648546:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788909333.648587:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875807019566464:12345-0@lo:400:kworker.0 Request processed in 58us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909333.648588:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875807019566208:0@lo:400:kworker.0 00000100:00100000:0.0:1788909333.648601:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788909333.650823:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875807019566464:0@lo:400:kworker.0 00000100:00100000:1.0:1788909333.651231:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788909333.651943:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019566336 00000100:00100000:1.0:1788909333.651953:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019566336 00000100:00100000:1.0:1788909333.652016:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788909333.652026:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019566336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788909333.652188:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875807019566336:12345-0@lo:400:kworker.0 Request processed in 161us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909333.652196:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788909333.652227:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875807019566336:0@lo:400:kworker.0 00000100:00080000:3.0:1788909333.652305:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788909333.682959:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909333.683139:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004905728 00000100:00100000:1.0:1788909333.683152:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004905728 00000100:00100000:1.0:1788909333.683241:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:1.0:1788909333.683253:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+19:14499:x1875807004905728:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1788909333.683279:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909333.683329:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6b99 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a64 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.684396:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6ba0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.684414:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.684426:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909333.684440:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788909333.684682:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6b99 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a64 expref: 22 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.684704:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a64 expref: 21 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.684715:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:1.0:1788909333.684718:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909333.684722:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769200, rc 0) 00000100:00100000:1.0:1788909333.684794:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:14499:x1875807004905728:12345-192.168.204.54@tcp:101:cat.0 Request processed in 1543us (1850us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788909333.684802:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788909333.693365:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909333.693416:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909333.693495:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004906112 00000100:00100000:1.0:1788909333.693509:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004906112 00000100:00100000:1.0:1788909333.693610:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1788909333.693624:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:2347:x1875807004906112:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909333.693664:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909333.693690:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6ba0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a64 expref: 21 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.693711:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:1.0:1788909333.693717:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909333.693790:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+20:2347:x1875807004906112:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 168us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909333.693798:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788909333.693975:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004905984 00000100:00100000:3.0:1788909333.693980:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004905984 00000100:00100000:3.0:1788909333.694016:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788909333.694024:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+20:14499:x1875807004905984:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:3.0:1788909333.694432:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:14499:x1875807004905984:12345-192.168.204.54@tcp:35:cat.0 Request processed in 408us (1080us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788909333.694440:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:0.0:1788909333.748237:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.748385:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004906368 00000100:00100000:2.0:1788909333.748413:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004906368 00000100:00100000:2.0:1788909333.748478:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:2.0:1788909333.748491:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:14505:x1875807004906368:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1788909333.748515:0:15177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909333.748536:0:15177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6bae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a6b expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.748638:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.748653:0:15177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a48 expref: 22 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.748660:0:15177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a4f expref: 22 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.748668:0:15177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.748699:0:15177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a4f expref: 22 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.748712:0:15177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a4f expref: 22 pid: 14468 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909333.748725:0:15177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d431c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15177:1875807019566592:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909333.748995:0:15177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a48 expref: 22 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.749018:0:15177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a48 expref: 22 pid: 15177 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909333.749028:0:15177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052d430700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15177:1875807019566720:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909333.749065:0:15177:0:(client.c:2715:ptlrpc_set_wait()) set ffff890506130240 going to sleep for 11 seconds 00000100:00100000:2.0:1788909333.755585:0:15177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d431c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15177:1875807019566592:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788909333.755602:0:15177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052d430700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15177:1875807019566720:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909333.755631:0:15177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909333.757293:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909333.757418:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909333.757507:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004906496 00000100:00100000:1.0:1788909333.757518:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004906496 00010000:00010000:1.0:1788909333.757562:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a4f expref: 23 pid: 14468 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909333.757604:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004906624 00000100:00100000:1.0:1788909333.757608:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004906624 00010000:00010000:1.0:1788909333.757621:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a48 expref: 24 pid: 15177 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909333.757744:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788909333.757756:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89051037a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:2349:x1875807004906496:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909333.757771:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909333.757787:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a4f expref: 24 pid: 14468 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.757801:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a4f expref: 24 pid: 14468 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.757847:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ac00/0x733cfdd8721d6b68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a4f expref: 24 pid: 14468 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.757865:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:1.0:1788909333.757870:0:14455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.757879:0:14455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.757886:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909333.757963:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89051037a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+23:2349:x1875807004906496:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 209us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909333.757971:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788909333.758027:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:1.0:1788909333.758035:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+22:2349:x1875807004906624:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909333.758053:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909333.758058:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a48 expref: 22 pid: 15177 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.758068:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a48 expref: 22 pid: 15177 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.758080:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a200/0x733cfdd8721d6b53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a48 expref: 22 pid: 15177 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.758100:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:1.0:1788909333.758103:0:14455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.758156:0:14455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.758165:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.758204:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909333.758227:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:2349:x1875807004906624:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 193us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909333.758233:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00010000:00010000:3.0:1788909333.766616:0:15177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909333.766636:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788909333.766672:0:15177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788909333.766897:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6bae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a6b expref: 22 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909333.766921:0:15177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a800/0x733cfdd8721d6bb5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a6b expref: 21 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909333.766931:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:3.0:1788909333.766934:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788909333.766938:0:15177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9a800, rc 0) 00000100:00100000:3.0:1788909333.767015:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:14505:x1875807004906368:12345-192.168.204.54@tcp:101:dd.0 Request processed in 18528us (18788us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788909333.767025:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1788909333.771843:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909333.771965:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004906880 00000100:00100000:1.0:1788909333.771980:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004906880 00000100:00100000:1.0:1788909333.772076:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1788909333.772088:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:14505:x1875807004906880:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:1.0:1788909333.772464:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.772485:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.772499:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788909333.772647:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788909333.772686:0:14467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf57e038 reply state 00000000377cef70 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909333.772715:0:14467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788909333.773063:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14505:x1875807004906880:12345-192.168.204.54@tcp:36:dd.0 Request processed in 975us (1228us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788909333.773072:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000020:00080000:1.0:1788909333.773079:0:14467:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788909333.777267:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.777345:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.777354:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.777361:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909333.777366:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.777375:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.777761:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:2.0:1788909333.777787:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909333.777796:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.777803:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769200/0x733cfdd8721d6bc3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909333.778569:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909333.779662:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004907008 00000100:00100000:0.0:1788909333.779676:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004907008 00000100:00100000:0.0:1788909333.779758:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1788909333.779770:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+23:14505:x1875807004907008:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:0.0:1788909333.779907:0:14469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909333.779932:0:14469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6bca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a72 expref: -99 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.780006:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6bca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a72 expref: 24 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.780022:0:14469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6bca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a72 expref: 24 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909333.780056:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:0.0:1788909333.780059:0:14469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788909333.780064:0:14469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517e00, rc 0) 00000100:00100000:0.0:1788909333.781403:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14505:x1875807004907008:12345-192.168.204.54@tcp:101:dd.0 Request processed in 1625us (2836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909333.782012:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:0.0:1788909333.806780:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.809396:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004907264 00000100:00100000:2.0:1788909333.809416:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004907264 00000100:00100000:2.0:1788909333.809514:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788909333.809527:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14505:x1875807004907264:12345-192.168.204.54@tcp:103:dd.0 00010000:00010000:2.0:1788909333.809545:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909333.809572:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517e00/0x733cfdd8721d6bca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a72 expref: 24 pid: 14469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.809594:0:14453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:2.0:1788909333.809599:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788909333.809771:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+23:14505:x1875807004907264:12345-192.168.204.54@tcp:103:dd.0 Request processed in 246us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.809779:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788909333.818944:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909333.819804:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004907392 00000100:00100000:1.0:1788909333.819816:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004907392 00000100:00100000:1.0:1788909333.819876:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:1.0:1788909333.819887:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905064d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+23:14505:x1875807004907392:12345-192.168.204.54@tcp:58:dd.0 00010000:00010000:1.0:1788909333.820029:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.820065:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909333.820079:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788909333.821527:0:14468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788909333.821687:0:14468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788909333.821760:0:14468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788909333.822032:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905064d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+23:14505:x1875807004907392:12345-192.168.204.54@tcp:58:dd.0 Request processed in 2142us (3098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909333.822061:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:3.0:1788909333.825908:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909333.826019:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004907520 00000100:00100000:2.0:1788909333.826031:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004907520 00000100:00100000:2.0:1788909333.826142:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:2.0:1788909333.826165:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8905344d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+23:14505:x1875807004907520:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1788909333.826190:0:15177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788909333.826211:0:15177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b200/0x733cfdd8721d6bd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a79 expref: -99 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.826300:0:15177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.826312:0:15177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b200/0x733cfdd8721d6bd8 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a79 expref: 24 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.826335:0:15177:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.826351:0:15177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b200/0x733cfdd8721d6bd8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a79 expref: 24 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.826366:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:2.0:1788909333.826370:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788909333.826374:0:15177:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b200/0x733cfdd8721d6bd8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a79 expref: 24 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909333.826383:0:15177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890401a9b200, rc 0) 00000100:00100000:2.0:1788909333.826440:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8905344d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14505:x1875807004907520:12345-192.168.204.54@tcp:101:dd.0 Request processed in 288us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909333.826448:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00010000:00010000:3.0:1788909334.085403:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788909334.533939:0:14501:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788909334.533950:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788909334.533990:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788909334.533996:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788909334.534179:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1875807019566848:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788909334.534321:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508877600 going to sleep for 11 seconds 00000100:00100000:1.0:1788909334.542257:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14501:1875807019566848:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788909334.544894:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909334.545185:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004907648 00000100:00100000:2.0:1788909334.545196:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004907648 00000100:00100000:2.0:1788909334.545279:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788909334.545293:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14507:x1875807004907648:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788909334.545419:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14507:x1875807004907648:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 128us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909334.545451:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00080000:3.0:1788909334.546350:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788909334.549466:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.549589:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004907776 00000100:00100000:1.0:1788909334.549604:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004907776 00000100:00100000:1.0:1788909334.549869:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788909334.549883:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053c8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14507:x1875807004907776:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788909334.550044:0:14467:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788909334.550257:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053c8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14507:x1875807004907776:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 377us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909334.550265:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:1.0:1788909334.555527:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909334.556422:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004907904 00000100:00100000:2.0:1788909334.556437:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004907904 00000100:00100000:2.0:1788909334.556518:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:2.0:1788909334.556531:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14507:x1875807004907904:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788909334.556618:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.556637:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.556662:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.556897:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557042:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557054:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557086:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557095:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557101:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788909334.557332:0:15177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788909334.557337:0:15177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788909334.557358:0:15177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557373:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557380:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557386:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557392:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9b800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909334.557399:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557407:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557423:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89050693b500) 00010000:00010000:2.0:1788909334.557426:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909334.557430:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557435:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b800/0x733cfdd8721d6bdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557466:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557482:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557488:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557493:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9ba00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909334.557496:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557501:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557511:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff89050693bd00) 00010000:00010000:2.0:1788909334.557513:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909334.557516:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557521:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6be6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557540:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557545:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557550:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557555:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9a400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909334.557574:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557581:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557589:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:2.0:1788909334.557591:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909334.557594:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.557599:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6bed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909334.558583:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14507:x1875807004907904:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 2044us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788909334.558598:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788909334.562809:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.562915:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004908160 00000100:00100000:1.0:1788909334.562929:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004908160 00000100:00100000:1.0:1788909334.563010:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1788909334.563023:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+24:14507:x1875807004908160:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909334.563059:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909334.563091:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d6bf4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a80 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563269:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563287:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563322:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909334.563339:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788909334.563480:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563489:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563496:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563503:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909334.563508:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563517:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563532:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:1.0:1788909334.563535:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788909334.563540:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563546:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6bfb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563599:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d6bf4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a80 expref: 26 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563622:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89050693b500) 00010000:00010000:1.0:1788909334.563625:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788909334.563629:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d6bf4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a80 expref: 26 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.563638:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769000, rc 0) 00000100:00100000:1.0:1788909334.563731:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+25:14507:x1875807004908160:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 711us (935us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788909334.563739:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:3.0:1788909334.573662:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909334.575975:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004908288 00000100:00100000:0.0:1788909334.575993:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004908288 00000100:00100000:0.0:1788909334.576818:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:0.0:1788909334.576835:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+25:14507:x1875807004908288:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788909334.576876:0:14469:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788909334.577010:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+25:14507:x1875807004908288:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 181us (3359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909334.577018:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:2.0:1788909334.582107:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.582303:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004908544 00000100:00100000:1.0:1788909334.582316:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004908544 00000100:00100000:1.0:1788909334.582393:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1788909334.582404:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+25:14507:x1875807004908544:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909334.582429:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909334.582461:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d6c09 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a87 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788909334.583586:0:14468:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1788909334.583596:0:14468:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788909334.583791:0:14468:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788909334.584252:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6c10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.584268:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6c10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.584279:0:14468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6c10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.584355:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d6c09 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a87 expref: 28 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.584432:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6c10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a87 expref: 27 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.584442:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5300) 00010000:00010000:1.0:1788909334.584445:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788909334.584448:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769800, rc 0) 00000100:00100000:1.0:1788909334.584525:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+27:14507:x1875807004908544:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2121us (2429us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788909334.584534:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:1.0:1788909334.588218:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909334.588440:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004908800 00000100:00100000:2.0:1788909334.588452:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004908800 00000100:00100000:2.0:1788909334.588507:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788909334.588517:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+27:14507:x1875807004908800:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788909334.588575:0:15177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788909334.588601:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769800/0x733cfdd8721d6c10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a87 expref: 27 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.588619:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5300) 00010000:00010000:2.0:1788909334.588628:0:15177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788909334.588663:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.588694:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.588705:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.588822:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.588832:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.588839:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589096:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589104:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589513:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589520:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9a400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909334.589526:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589534:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589548:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890513293100) 00010000:00010000:2.0:1788909334.589562:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909334.589567:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589574:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9a400/0x733cfdd8721d6c1e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589588:0:15177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589593:0:15177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589600:0:15177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589605:0:15177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9ba00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1788909334.589609:0:15177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589615:0:15177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589623:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x1c965c05 (ffff89050693bd00) 00010000:00010000:2.0:1788909334.589626:0:15177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788909334.589629:0:15177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.589635:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9ba00/0x733cfdd8721d6c25 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1c965c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909334.590097:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+26:14507:x1875807004908800:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1572us (1883us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788909334.590146:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788909334.593252:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.593540:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004908928 00000100:00100000:1.0:1788909334.593552:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004908928 00000100:00100000:1.0:1788909334.593661:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1788909334.593676:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+26:14507:x1875807004908928:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909334.593701:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909334.593728:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d6c2c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a8e expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.593777:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d6c33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.593789:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d6c33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.593812:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d6c33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.593931:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d6c2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a8e expref: 28 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.593950:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769400/0x733cfdd8721d6c33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a8e expref: 27 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.593960:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5600) 00010000:00010000:1.0:1788909334.593963:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788909334.593968:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c769400, rc 0) 00000100:00100000:1.0:1788909334.594058:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+27:14507:x1875807004908928:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 386us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909334.594074:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1788909334.597565:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909334.597988:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004909184 00000100:00100000:0.0:1788909334.598020:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004909184 00000100:00100000:0.0:1788909334.598598:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788909334.598610:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+27:14507:x1875807004909184:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788909334.598699:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.598717:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.598838:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788909334.599594:0:14469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788909334.599607:0:14469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416673496909ns, next at 417673494547ns, rc = 0 00000004:00010000:0.0:1788909334.599706:0:14469:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df05cf97 reply state 000000005f148f99 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909334.599716:0:14469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788909334.599924:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+29:14507:x1875807004909184:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1314us (2367us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788909334.599933:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00010000:00010000:1.0:1788909334.605366:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.605403:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.605411:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.605416:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1788909334.605438:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.605479:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.605496:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5600) 00010000:00010000:1.0:1788909334.605499:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788909334.605504:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.605510:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c517a00/0x733cfdd8721d6c3a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909334.606983:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909334.607317:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004909312 00000100:00100000:3.0:1788909334.607328:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004909312 00000100:00100000:3.0:1788909334.607475:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:3.0:1788909334.607486:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+28:14507:x1875807004909312:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788909334.607511:0:14468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788909334.607532:0:14468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a95 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.607596:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a95 expref: 29 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.607614:0:14468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a95 expref: 29 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.607635:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5600) 00010000:00010000:3.0:1788909334.607638:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788909334.607641:0:14468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8905180a6200, rc 0) 00000100:00100000:3.0:1788909334.607743:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+29:14507:x1875807004909312:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 259us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909334.607750:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:2.0:1788909334.612000:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909334.612156:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004909440 00000100:00100000:3.0:1788909334.612167:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004909440 00000100:00100000:3.0:1788909334.612231:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788909334.612244:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2349:x1875807004909440:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788909334.612976:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:2349:x1875807004909440:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 728us (981us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788909334.612987:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1788909334.619664:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909334.619838:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004909696 00000100:00100000:3.0:1788909334.619850:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004909696 00000100:00100000:3.0:1788909334.619929:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788909334.619942:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+29:14507:x1875807004909696:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788909334.620290:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+30:14507:x1875807004909696:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 350us (635us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788909334.620299:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788909334.627253:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909334.627357:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004909952 00000100:00100000:3.0:1788909334.627430:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004909952 00000100:00100000:3.0:1788909334.627554:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:3.0:1788909334.627565:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+30:14507:x1875807004909952:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788909334.627700:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+30:14507:x1875807004909952:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 137us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909334.627709:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:2.0:1788909334.630813:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.630947:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004910080 00000100:00100000:1.0:1788909334.630959:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004910080 00000100:00100000:1.0:1788909334.631051:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1788909334.631063:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+30:14507:x1875807004910080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788909334.631087:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788909334.631147:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d6c48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44a9c expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.631215:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d6c4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.631234:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d6c4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.631247:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d6c4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788909334.631295:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788909334.631341:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d6c4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.631765:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c769000/0x733cfdd8721d6c48 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a9c expref: 32 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.631789:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d6c4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a9c expref: 31 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.631799:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5600) 00010000:00010000:1.0:1788909334.631802:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788909334.631806:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c768800, rc 0) 00000100:00100000:1.0:1788909334.632052:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+31:14507:x1875807004910080:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 990us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909334.632061:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1788909334.636459:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909334.636597:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004910208 00000100:00100000:0.0:1788909334.636608:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004910208 00000100:00100000:0.0:1788909334.636687:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788909334.636697:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+6:2348:x1875807004910208:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909334.636718:0:15155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909334.636755:0:15155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44aa3 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788909334.636801:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa09715, blocks: 0x1 00010000:00010000:0.0:1788909334.636822:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788909334.636827:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909334.636837:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44aa3 expref: 7 pid: 15155 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.636857:0:15155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44aa3 expref: 7 pid: 15155 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.636871:0:15155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517800, rc 0) 00000100:00100000:0.0:1788909334.637263:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:2348:x1875807004910208:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 566us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909334.637271:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:2.0:1788909334.641823:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909334.642052:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004910464 00000100:00100000:0.0:1788909334.642063:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004910464 00000100:00100000:0.0:1788909334.642206:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:0.0:1788909334.642218:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+31:14507:x1875807004910464:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788909334.642350:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+31:14507:x1875807004910464:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 134us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909334.642359:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:1.0:1788909334.647480:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909334.647701:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004910592 00000100:00100000:3.0:1788909334.647712:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004910592 00000100:00100000:3.0:1788909334.647868:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:3.0:1788909334.647876:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+31:14507:x1875807004910592:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788909334.726055:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1788909334.726071:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788909334.726091:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000100:00100000:0.0:1788909334.726299:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788909334.726320:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019566976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788909334.726393:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788909334.726480:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019566976 00000100:00100000:0.0:1788909334.726498:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019566976 00000100:00100000:0.0:1788909334.726537:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788909334.726545:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875807019566976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788909334.726732:0:15153:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788909334.726737:0:15153:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788909334.726740:0:15153:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788909334.726742:0:15153:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788909333 -> 1788909333 00002000:00010000:0.0:1788909334.726744:0:15153:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788909334.726796:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875807019566976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (402us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788909334.726803:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1788909334.726849:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890510386680/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788909334.726854:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875807019566976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788909334.727951:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+18:14507:x1875807004910592:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 80062us (82036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909334.727965:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000001:00080000:1.0:1788909334.728881:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1788909334.728919:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788909334.732414:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909334.733058:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004910720 00000100:00100000:0.0:1788909334.733070:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004910720 00000100:00100000:1.0:1788909334.733238:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788909334.733257:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:2350:x1875807004910720:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788909334.733564:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:2350:x1875807004910720:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 314us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909334.733572:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788909334.736597:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909334.736714:0:15177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004910976 00000100:00100000:3.0:1788909334.736738:0:15177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004910976 00000100:00100000:3.0:1788909334.736846:0:15177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788909334.736857:0:15177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+14:14507:x1875807004910976:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788909334.736940:0:15177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909334.736970:0:15177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768800/0x733cfdd8721d6c4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a9c expref: 14 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.736991:0:15177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5600) 00010000:00010000:3.0:1788909334.736996:0:15177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788909334.737184:0:15177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.737202:0:15177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.737213:0:15177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788909334.737399:0:15177:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a9f4eb5 reply state 00000000fdc10e56 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909334.737409:0:15177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788909334.737624:0:15177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+15:14507:x1875807004910976:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 768us (1041us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788909334.737632:0:15177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00010000:00010000:0.0:1788909334.743164:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.743182:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.743190:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.743197:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1788909334.743202:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.743209:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.743248:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5600) 00010000:00010000:0.0:1788909334.743251:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788909334.743256:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.743262:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c5d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909334.749904:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909334.750021:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004911104 00000100:00100000:0.0:1788909334.750041:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004911104 00000100:00100000:0.0:1788909334.750185:0:15153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:0.0:1788909334.750194:0:15153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:14507:x1875807004911104:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788909334.750210:0:15153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788909334.750226:0:15153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb281451763a44aaa expref: -99 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.750259:0:15153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44aa3 expref: 8 pid: 15155 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.750268:0:15153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909334.750273:0:15153:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909334.750278:0:15153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 8 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.750309:0:15153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aa3 expref: 8 pid: 15155 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.750342:0:15153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aa3 expref: 8 pid: 15155 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909334.750357:0:15153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff890510385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15153:1875807019567104:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788909334.750436:0:15153:0:(client.c:2715:ptlrpc_set_wait()) set ffff890511a580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788909334.756301:0:15153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff890510385880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15153:1875807019567104:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788909334.756343:0:15153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 8 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.756369:0:15153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89053c517a00, rc 0) 00000100:00100000:0.0:1788909334.756430:0:15153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+8:14507:x1875807004911104:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 6236us (6534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788909334.756440:0:15153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:2.0:1788909334.762207:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909334.762292:0:16582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004911232 00000100:00100000:3.0:1788909334.762301:0:16582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004911232 00010000:00010000:3.0:1788909334.762348:0:16582:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aa3 expref: 8 pid: 15155 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909334.762390:0:16582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788909334.762399:0:16582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052d431500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+8:2349:x1875807004911232:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788909334.762427:0:16582:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788909334.762513:0:16582:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aa3 expref: 8 pid: 15155 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.762532:0:16582:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aa3 expref: 8 pid: 15155 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.762562:0:16582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bce7b308/0x733cfdd8721d6c56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aa3 expref: 8 pid: 15155 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.762577:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909334.762585:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909334.762592:0:16582:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 7 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.762603:0:16582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 7 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.762749:0:16582:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 7 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909334.762821:0:16582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16582:1875807019567232:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788909334.762920:0:16582:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905205b4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909334.769272:0:16582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16582:1875807019567232:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788909334.769311:0:16582:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788909334.769606:0:16582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052d431500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:2349:x1875807004911232:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 7206us (7409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909334.769618:0:16582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788909334.769803:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909334.770339:0:15931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004911360 00000100:00100000:0.0:1788909334.770349:0:15931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004911360 00000100:00100000:0.0:1788909334.770638:0:15931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1788909334.770649:0:15931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:2349:x1875807004911360:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788909334.771000:0:15931:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788909334.771004:0:15931:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788909333 00002000:00010000:0.0:1788909334.771007:0:15931:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788909332 00002000:00010000:0.0:1788909334.771010:0:15931:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788909333 -> 1788909333 00002000:00010000:0.0:1788909334.771012:0:15931:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788909334.771173:0:15931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+8:2349:x1875807004911360:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 524us (1369us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788909334.771193:0:15931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788909334.776589:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.776841:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004911488 00000100:00100000:1.0:1788909334.776855:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004911488 00000100:00100000:1.0:1788909334.777089:0:15154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1788909334.777100:0:15154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+8:2350:x1875807004911488:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788909334.777192:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.777214:0:15154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 8 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.777224:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909334.777228:0:15154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788909334.777233:0:15154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.777270:0:15154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 8 pid: 15153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.777298:0:15154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 8 pid: 15153 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909334.777315:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15154:1875807019567360:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909334.777420:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508877300 going to sleep for 11 seconds 00000100:00100000:2.0:1788909334.781618:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15154:1875807019567360:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788909334.781683:0:15154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909334.788232:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.788535:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004911616 00000100:00100000:1.0:1788909334.788546:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004911616 00010000:00010000:1.0:1788909334.788591:0:14453:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 9 pid: 15153 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909334.788657:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788909334.788668:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+9:2349:x1875807004911616:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909334.788683:0:14453:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909334.788706:0:14453:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 9 pid: 15153 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.788722:0:14453:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 9 pid: 15153 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.788749:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b7c0ef0/0x733cfdd8721d6c64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xb281451763a44aaa expref: 9 pid: 15153 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.789215:0:14453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788909334.789223:0:14453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788909334.789231:0:14453:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.789250:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.789458:0:14453:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909334.789538:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+8:2349:x1875807004911616:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 870us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909334.789548:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:2.0:1788909334.790068:0:15154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.790080:0:15154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.790284:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.790294:0:15154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.790304:0:15154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.790311:0:15154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:3.0:1788909334.790316:0:15154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.790324:0:15154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.790340:0:15154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.790348:0:15154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd6bb0d/0x733cfdd8721d6c6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909334.790419:0:15154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:2350:x1875807004911488:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 13320us (14148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788909334.790438:0:15154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788909334.794101:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.794219:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004911872 00000100:00100000:1.0:1788909334.794229:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004911872 00000100:00100000:1.0:1788909334.794290:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:1.0:1788909334.794302:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+14:14507:x1875807004911872:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788909334.794388:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.794406:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.794418:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.794781:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.794794:0:14467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a95 expref: 15 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.794802:0:14467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.794833:0:14467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a95 expref: 15 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.794847:0:14467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a95 expref: 15 pid: 14468 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909334.794862:0:14467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14467:1875807019567488:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788909334.794950:0:14467:0:(client.c:2715:ptlrpc_set_wait()) set ffff890508877cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788909334.800301:0:14467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89053cb93800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14467:1875807019567488:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788909334.800344:0:14467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909334.807020:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.807152:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004912000 00000100:00100000:1.0:1788909334.807161:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004912000 00010000:00010000:1.0:1788909334.807204:0:14455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a95 expref: 16 pid: 14468 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909334.807249:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1788909334.807259:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052df6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+16:2350:x1875807004912000:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788909334.807398:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788909334.807408:0:14455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a95 expref: 16 pid: 14468 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.807423:0:14455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a95 expref: 16 pid: 14468 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.807461:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a6200/0x733cfdd8721d6c41 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xb281451763a44a95 expref: 16 pid: 14468 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.807478:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5600) 00010000:00010000:1.0:1788909334.807482:0:14455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.807492:0:14455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.807499:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.807569:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788909334.807629:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17266de6-98eb-4db6-abc9-b5293f8b8e05+15:2350:x1875807004912000:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 371us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909334.807644:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:3.0:1788909334.808344:0:14467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.808355:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788909334.808659:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788909334.808810:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788909334.808854:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788909334.809006:0:14467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14467:1875807019567616:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788909334.809285:0:14467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909334.809326:0:14467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8905274af300 going to sleep for 11 seconds 00000100:00100000:1.0:1788909334.809419:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019567616 00000100:00100000:1.0:1788909334.809427:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019567616 00000100:00100000:1.0:1788909334.809583:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788909334.809593:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14467:x1875807019567616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788909334.809678:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14467:x1875807019567616:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909334.809686:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788909334.809770:0:14467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14467:1875807019567616:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788909334.813519:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788909334.813630:0:14467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14467:1875807019567744:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788909334.813724:0:14467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788909334.818556:0:14467:0:(client.c:2715:ptlrpc_set_wait()) set ffff890503919e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788909334.818557:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807019567744 00000100:00100000:2.0:1788909334.818570:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807019567744 00000100:00100000:2.0:1788909334.818752:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788909334.818820:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89052dcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14467:x1875807019567744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788909334.819081:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052dcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14467:x1875807019567744:12345-0@lo:1000:mdt00_000.0 Request processed in 263us (5356us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788909334.819429:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788909334.819845:0:14467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14467:1875807019567744:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788909334.819896:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.819908:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.819930:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.819937:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909334.819942:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.819949:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.819965:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5600) 00010000:00010000:3.0:1788909334.819968:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788909334.819972:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.819979:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768600/0x733cfdd8721d6c79 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.820013:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.820020:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.820036:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.820041:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909334.820044:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.820062:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.820072:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:3.0:1788909334.820074:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788909334.820081:0:14467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b200/0x733cfdd8721d6bd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a79 expref: 18 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.820092:0:14467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b200/0x733cfdd8721d6bd8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a79 expref: 18 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.820101:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b200/0x733cfdd8721d6bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a79 expref: 18 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.820860:0:14467:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b200/0x733cfdd8721d6bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xb281451763a44a79 expref: 18 pid: 15177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788909334.820878:0:14467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14467:1875807019567872:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788909334.820962:0:14467:0:(client.c:2715:ptlrpc_set_wait()) set ffff890503919c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788909334.824958:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909334.825031:0:14467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff89052dcc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14467:1875807019567872:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788909334.825062:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825074:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768200/0x733cfdd8721d6bd1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14468 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909334.825083:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004912128 00000100:00100000:1.0:1788909334.825092:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004912128 00010000:00010000:3.0:1788909334.825131:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825159:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825172:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825182:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825189:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909334.825195:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00010000:00010000:3.0:1788909334.825201:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825209:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7a00 already unused, calling callback (ffffffffc1f744f0) 00000100:00100000:1.0:1788909334.825211:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89050931a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+19:14505:x1875807004912128:12345-192.168.204.54@tcp:49:dd.0 00010000:00010000:3.0:1788909334.825214:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825224:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825234:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:3.0:1788909334.825237:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788909334.825254:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825260:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8905180a7a00/0x733cfdd8721d6c80 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825269:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825289:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825295:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825299:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1788909334.825302:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825307:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825317:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89050693be00) 00010000:00010000:3.0:1788909334.825319:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788909334.825321:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.825326:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89053c768400/0x733cfdd8721d6c72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909334.825338:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89050931a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+19:14505:x1875807004912128:12345-192.168.204.54@tcp:49:dd.0 Request processed in 129us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788909334.825346:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788909334.825532:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89052df6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+18:14507:x1875807004911872:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 31232us (31441us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788909334.825540:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000020:00080000:3.0:1788909334.825544:0:14467:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788909334.826967:0:14501:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788909334.826976:0:14501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788909334.827006:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788909334.827013:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788909334.836285:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788909334.837607:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004912384 00000100:00100000:3.0:1788909334.837621:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004912384 00000100:00100000:3.0:1788909334.837698:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:3.0:1788909334.837710:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+18:14507:x1875807004912384:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788909334.844279:0:14471:0:(mdd_object.c:4179:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788909334.844430:0:14471:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788909334.844534:0:14471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.844644:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.844659:0:14471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.844668:0:14471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.844680:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.844686:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909334.844770:0:14471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788909334.844901:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17266de6-98eb-4db6-abc9-b5293f8b8e05+20:14507:x1875807004912384:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 7184us (8627us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788909334.844925:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000020:00080000:2.0:1788909334.844931:0:14471:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788909334.845190:0:14457:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788909334.845199:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.845213:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9b000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909334.845219:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.845228:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.845243:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890520ac5600) 00010000:00010000:0.0:1788909334.845246:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788909334.845250:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.845257:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890401a9b000/0x733cfdd8721d6c87 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909334.845271:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909334.845273:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788909334.845276:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788909334.981849:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909334.981958:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004912512 00000100:00100000:1.0:1788909334.981971:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004912512 00000100:00100000:1.0:1788909334.982072:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788909334.982083:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+7:2348:x1875807004912512:12345-192.168.204.54@tcp:4:dd.0 00002000:00010000:1.0:1788909334.982170:0:15158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa09715, atime: 0x6aa09714, ctime: 0x6aa09715, blocks: 0x1 00010000:00010000:1.0:1788909334.982195:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.982210:0:15158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788909334.982215:0:15158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909334.982222:0:15158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909334.982239:0:15158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909334.994625:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909334.994670:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909334.994761:0:15159:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788909334.994777:0:15159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788909334.994867:0:15160:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788909334.994953:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004912768 00000100:00100000:3.0:1788909334.994962:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004912768 00000100:00100000:3.0:1788909334.995009:0:15160:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788909334.995015:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004912640 00000100:00100000:3.0:1788909334.995031:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004912640 00000100:00100000:3.0:1788909334.998953:0:16696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:3.0:1788909334.998976:0:16696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+10:2347:x1875807004912768:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:3.0:1788909334.999015:0:16696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.999044:0:16696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909334.999048:0:16696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788909334.999055:0:16696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909334.999070:0:16696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909335.000734:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909335.004275:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909335.008047:0:15160:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788909335.008613:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788909335.008645:0:15160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788909335.008797:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004912896 00000100:00100000:2.0:1788909335.008806:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004912896 00000100:00100000:2.0:1788909335.008869:0:15160:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788909335.008876:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004913024 00000100:00100000:2.0:1788909335.008879:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004913024 00000100:00080000:2.0:1788909335.008900:0:14464:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788909335.009723:0:16697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788909335.009736:0:16697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:17266de6-98eb-4db6-abc9-b5293f8b8e05+13:2347:x1875807004912640:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:2.0:1788909335.009776:0:16697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.009793:0:16697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909335.009799:0:16697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909335.009806:0:16697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.009820:0:16697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909335.012297:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788909335.012405:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788909335.012613:0:15159:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788909335.012624:0:15159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1788909335.012759:0:15160:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788909335.012769:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004913152 00000100:00100000:3.0:1788909335.012778:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004913152 00000100:00100000:3.0:1788909335.012826:0:15160:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788909335.012831:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004913280 00000100:00100000:3.0:1788909335.012834:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004913280 00000100:00100000:3.0:1788909335.012846:0:15160:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788909335.012851:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875807004913408 00000100:00100000:3.0:1788909335.012853:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875807004913408 00000100:00100000:1.0:1788909335.016650:0:16698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788909335.016672:0:16698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:17266de6-98eb-4db6-abc9-b5293f8b8e05+17:2348:x1875807004912896:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:1.0:1788909335.016716:0:16698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909335.016734:0:16698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909335.016737:0:16698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788909335.016744:0:16698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909335.016759:0:16698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788909335.099685:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1788909335.099704:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1788909335.099722:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1788909335.099747:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1788909335.100228:0:15158:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1788909335.100241:0:15158:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788909333 -> 1788909334 00002000:00010000:0.0:1788909335.100245:0:15158:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788909333 -> 1788909334 00002000:00010000:0.0:1788909335.100247:0:15158:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1788909335.100263:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.100276:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.100285:0:15158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.100292:0:15158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c768a00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909335.100296:0:15158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.100305:0:15158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.100329:0:15158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.100336:0:15158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080c84d1f/0x733cfdd8721d6c8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909335.100445:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:2348:x1875807004912512:12345-192.168.204.54@tcp:4:dd.0 Request processed in 118359us (118606us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788909335.100460:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788909335.100499:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788909335.100512:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+20:2347:x1875807004913024:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:0.0:1788909335.100548:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.100562:0:15158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909335.100567:0:15158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909335.100573:0:15158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.100586:0:15158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788909335.110444:0:14456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788909335.133779:0:16697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1788909335.133789:0:16697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:2.0:1788909335.133804:0:16697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.133818:0:16697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.133828:0:16697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.133836:0:16697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9ae00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909335.133841:0:16697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.133851:0:16697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.133872:0:16697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.133879:0:16697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc7ac92/0x733cfdd8721d6c9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909335.133975:0:16697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:17266de6-98eb-4db6-abc9-b5293f8b8e05+22:2347:x1875807004912640:12345-192.168.204.54@tcp:4:dd.0 Request processed in 124236us (139297us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788909335.134002:0:16697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788909335.134046:0:16697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:2.0:1788909335.134058:0:16697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:2348:x1875807004913152:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:2.0:1788909335.134092:0:16697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134105:0:16697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909335.134214:0:16697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909335.134221:0:16697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134234:0:16697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.134449:0:16698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.134459:0:16698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.134466:0:16698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.134472:0:16698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c769000 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909335.134475:0:16698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.134483:0:16698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.134504:0:16698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.134511:0:16698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002b514e8/0x733cfdd8721d6ca3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909335.134546:0:16698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:17266de6-98eb-4db6-abc9-b5293f8b8e05+21:2348:x1875807004912896:12345-192.168.204.54@tcp:4:dd.0 Request processed in 117884us (133820us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788909335.134553:0:16698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788909335.134570:0:16698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788909335.134578:0:16698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:17266de6-98eb-4db6-abc9-b5293f8b8e05+20:2347:x1875807004913280:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:0.0:1788909335.134594:0:16698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.134603:0:16698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909335.134606:0:16698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788909335.134611:0:16698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.134620:0:16698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134729:0:16696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134739:0:16696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134747:0:16696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134753:0:16696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8905180a7a00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909335.134757:0:16696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134776:0:16696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134787:0:16696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134795:0:16696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bcd668/0x733cfdd8721d6c95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909335.134827:0:16696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+20:2347:x1875807004912768:12345-192.168.204.54@tcp:4:dd.0 Request processed in 135860us (140213us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788909335.134834:0:16696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788909335.134850:0:16696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788909335.134858:0:16696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890510386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+19:2348:x1875807004913408:12345-192.168.204.54@tcp:4:dd.0 00010000:00010000:2.0:1788909335.134873:0:16696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134882:0:16696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909335.134885:0:16696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788909335.134890:0:16696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.134899:0:16696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788909335.135212:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:1.0:1788909335.171992:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1788909335.172278:0:15158:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:0.0:1788909335.172284:0:15158:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1788909335.172300:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.172330:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.172340:0:15158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.172347:0:15158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517600 already unused, calling callback (ffffffffc156a250) 00010000:00010000:0.0:1788909335.172352:0:15158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.172361:0:15158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.172386:0:15158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.172395:0:15158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078efbe5e/0x733cfdd8721d6caa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909335.172789:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89053cb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17266de6-98eb-4db6-abc9-b5293f8b8e05+17:2347:x1875807004913024:12345-192.168.204.54@tcp:4:dd.0 Request processed in 72273us (168519us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788909335.172800:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00002000:00010000:2.0:1788909335.215253:0:16696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:2.0:1788909335.215278:0:16696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.215293:0:16696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.215303:0:16696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.215311:0:16696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9ba00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:2.0:1788909335.215317:0:16696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.215326:0:16696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.215351:0:16696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788909335.215359:0:16696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092579ed0/0x733cfdd8721d6cbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788909335.215450:0:16696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:17266de6-98eb-4db6-abc9-b5293f8b8e05+15:2348:x1875807004913408:12345-192.168.204.54@tcp:4:dd.0 Request processed in 80588us (203041us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788909335.215476:0:16696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00010000:00010000:0.0:1788909335.216064:0:16697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.216090:0:16697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.216098:0:16697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.216104:0:16697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890401a9b800 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909335.216319:0:16698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909335.216328:0:16698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909335.216336:0:16698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909335.216342:0:16698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89053c517c00 already unused, calling callback (ffffffffc156a250) 00010000:00010000:1.0:1788909335.216346:0:16698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909335.216354:0:16698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909335.216373:0:16698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788909335.216381:0:16698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006887739/0x733cfdd8721d6cb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788909335.216493:0:16698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:17266de6-98eb-4db6-abc9-b5293f8b8e05+13:2347:x1875807004913280:12345-192.168.204.54@tcp:4:dd.0 Request processed in 81913us (204267us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788909335.216513:0:16698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000001:00080000:1.0:1788909335.216546:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1788909335.216686:0:16697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.216698:0:16697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.216782:0:16697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788909335.216791:0:16697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002198321b/0x733cfdd8721d6cb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788909335.216836:0:16697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890510386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:17266de6-98eb-4db6-abc9-b5293f8b8e05+5:2348:x1875807004913152:12345-192.168.204.54@tcp:4:dd.0 Request processed in 82782us (208228us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788909335.216844:0:16697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00010000:00010000:3.0:1788909336.133957:0:15934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788909336.602022:0:16736:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788909337.158575:0:14457:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28648 lines, 28648 kept, 0 dropped, 0 bad.